2023-03-03T07:26:49.787 INFO:root:teuthology version: 0.0.1.dev49+gc7c3cc8 2023-03-03T07:26:49.788 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/full/{begin/{0-install 1-ceph 2-logrotate} clusters/1-node-1-mds-1-osd conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mgr-osd-full} --owner scheduled_vshankar@teuthology --name vshankar-2023-03-03_04:39:14-fs-wip-vshankar-testing-20230303.023823-testing-default-smithi --verbose --archive /home/teuthworker/archive/vshankar-2023-03-03_04:39:14-fs-wip-vshankar-testing-20230303.023823-testing-default-smithi/7192208 -- /home/teuthworker/archive/vshankar-2023-03-03_04:39:14-fs-wip-vshankar-testing-20230303.023823-testing-default-smithi/7192208/orig.config.yaml 2023-03-03T07:26:49.866 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2023-03-03T07:26:49.943 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-03-03_04:39:14-fs-wip-vshankar-testing-20230303.023823-testing-default-smithi/7192208 branch: wip-vshankar-testing-20230303.023823 description: fs/full/{begin/{0-install 1-ceph 2-logrotate} clusters/1-node-1-mds-1-osd conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mgr-osd-full} email: vshankar@redhat.com first_in_suite: false job_id: '7192208' kernel: flavor: default kdb: true sha1: 75534f74ac3dd06f86697ff862e8be2945b3c8e6 last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-03-03_04:39:14-fs-wip-vshankar-testing-20230303.023823-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 1 size: 5 - machine: disk: 10 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-vshankar-testing-20230303.023823 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: osd_pool_default_min_size: 1 osd_pool_default_size: 1 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 1073741824 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_NEARFULL - POOL_BACKFILLFULL - PG_DEGRADED - OSD_OUT_OF_ORDER_FULL - OSD_NEARFULL - OSD_FULL sha1: 472aaef4ec3b3a2c29f73ca67854785a910f1f9b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 472aaef4ec3b3a2c29f73ca67854785a910f1f9b thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20230303.023823 sha1: 472aaef4ec3b3a2c29f73ca67854785a910f1f9b owner: scheduled_vshankar@teuthology priority: 100 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - osd.0 - client.0 sha1: 472aaef4ec3b3a2c29f73ca67854785a910f1f9b sleep_before_teardown: 0 suite: fs suite_branch: wip-vshankar-testing-20230303.023823 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_472aaef4ec3b3a2c29f73ca67854785a910f1f9b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 472aaef4ec3b3a2c29f73ca67854785a910f1f9b syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi057.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - ceph-fuse: null - workunit: cleanup: true clients: client.0: - fs/full/subvolume_rm.sh - workunit: cleanup: true clients: client.0: - fs/full/subvolume_clone.sh - workunit: cleanup: true clients: client.0: - fs/full/subvolume_snapshot_rm.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6 timestamp: 2023-03-03_04:39:14 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.31660 2023-03-03T07:26:49.943 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_472aaef4ec3b3a2c29f73ca67854785a910f1f9b/qa; will attempt to use it 2023-03-03T07:26:49.944 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_472aaef4ec3b3a2c29f73ca67854785a910f1f9b/qa/tasks 2023-03-03T07:26:49.944 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-03-03T07:26:49.946 INFO:teuthology.task.internal:Checking packages... 2023-03-03T07:26:49.976 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '472aaef4ec3b3a2c29f73ca67854785a910f1f9b' 2023-03-03T07:26:49.976 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-03-03T07:26:49.976 INFO:teuthology.packaging:ref: None 2023-03-03T07:26:49.977 INFO:teuthology.packaging:tag: None 2023-03-03T07:26:49.977 INFO:teuthology.packaging:branch: wip-vshankar-testing-20230303.023823 2023-03-03T07:26:49.977 INFO:teuthology.packaging:sha1: 472aaef4ec3b3a2c29f73ca67854785a910f1f9b 2023-03-03T07:26:49.977 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-vshankar-testing-20230303.023823 2023-03-03T07:26:50.122 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-2739-g472aaef4-1focal 2023-03-03T07:26:50.122 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-03-03T07:26:50.127 INFO:teuthology.task.internal:no buildpackages task found 2023-03-03T07:26:50.127 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-03-03T07:26:50.134 INFO:teuthology.task.internal:Saving configuration 2023-03-03T07:26:50.151 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-03-03T07:26:50.156 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-03-03T07:26:50.184 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi057.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-03-03_04:39:14-fs-wip-vshankar-testing-20230303.023823-testing-default-smithi/7192208', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-03-03 07:20:33.714760', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-03-03T07:26:50.185 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-03-03T07:26:50.192 INFO:teuthology.task.internal:roles: ubuntu@smithi057.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'osd.0', 'client.0'] 2023-03-03T07:26:50.193 INFO:teuthology.run_tasks:Running task console_log... 2023-03-03T07:26:50.236 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8b496484c0>, signals=[15]) 2023-03-03T07:26:50.238 INFO:teuthology.run_tasks:Running task internal.connect... 2023-03-03T07:26:50.244 INFO:teuthology.task.internal:Opening connections... 2023-03-03T07:26:50.245 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi057.front.sepia.ceph.com 2023-03-03T07:26:50.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-03T07:26:50.309 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-03-03T07:26:50.324 DEBUG:teuthology.orchestra.run.smithi057:> uname -m 2023-03-03T07:26:50.431 INFO:teuthology.orchestra.run.smithi057.stdout:x86_64 2023-03-03T07:26:50.432 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release 2023-03-03T07:26:50.438 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="Ubuntu" 2023-03-03T07:26:50.438 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-03-03T07:26:50.438 INFO:teuthology.orchestra.run.smithi057.stdout:ID=ubuntu 2023-03-03T07:26:50.438 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE=debian 2023-03-03T07:26:50.438 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-03-03T07:26:50.438 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="20.04" 2023-03-03T07:26:50.439 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://www.ubuntu.com/" 2023-03-03T07:26:50.439 INFO:teuthology.orchestra.run.smithi057.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-03-03T07:26:50.439 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-03-03T07:26:50.439 INFO:teuthology.orchestra.run.smithi057.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-03-03T07:26:50.439 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_CODENAME=focal 2023-03-03T07:26:50.439 INFO:teuthology.orchestra.run.smithi057.stdout:UBUNTU_CODENAME=focal 2023-03-03T07:26:50.440 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2023-03-03T07:26:50.467 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-03-03T07:26:50.480 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-03-03T07:26:50.485 INFO:teuthology.task.internal:Checking for old test directory... 2023-03-03T07:26:50.486 DEBUG:teuthology.orchestra.run.smithi057:> test '!' -e /home/ubuntu/cephtest 2023-03-03T07:26:50.491 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-03-03T07:26:50.497 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-03-03T07:26:50.497 DEBUG:teuthology.orchestra.run.smithi057:> test -z $(ls -A /var/lib/ceph) 2023-03-03T07:26:50.514 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-03-03T07:26:50.550 INFO:teuthology.run_tasks:Running task kernel... 2023-03-03T07:26:50.564 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '75534f74ac3dd06f86697ff862e8be2945b3c8e6'} 2023-03-03T07:26:50.565 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': '75534f74ac3dd06f86697ff862e8be2945b3c8e6'}}, timeout 300 2023-03-03T07:26:50.566 DEBUG:teuthology.orchestra.run.smithi057:> test -f /run/.containerenv -o -f /.dockerenv 2023-03-03T07:26:50.571 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-03T07:26:50.572 DEBUG:teuthology.task.kernel:sha1 for mon.a is 75534f74ac3dd06f86697ff862e8be2945b3c8e6 2023-03-03T07:26:50.572 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "75534f74ac3dd06f86697ff862e8be2945b3c8e6"... 2023-03-03T07:26:50.572 DEBUG:teuthology.orchestra.run.smithi057:> uname -r 2023-03-03T07:26:50.578 INFO:teuthology.orchestra.run.smithi057.stdout:5.4.0-124-generic 2023-03-03T07:26:50.579 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-124-generic vs 75534f74ac3dd06f86697ff862e8be2945b3c8e6 2023-03-03T07:26:50.579 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-03-03T07:26:50.579 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=75534f74ac3dd06f86697ff862e8be2945b3c8e6 2023-03-03T07:26:50.722 INFO:teuthology.task.kernel:Installing linux-firmware on mon.a... 2023-03-03T07:26:50.722 DEBUG:teuthology.orchestra.run.smithi057:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-03-03T07:26:50.736 INFO:teuthology.orchestra.run.smithi057.stderr:bash: line 0: cd: /lib/firmware/updates: No such file or directory 2023-03-03T07:26:50.843 INFO:teuthology.orchestra.run.smithi057.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-03-03T07:26:50.845 DEBUG:teuthology.orchestra.run.smithi057:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-03-03T07:26:50.922 DEBUG:teuthology.orchestra.run.smithi057:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-03-03T07:26:50.939 DEBUG:teuthology.orchestra.run.smithi057:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-03-03T07:27:31.982 INFO:teuthology.orchestra.run.smithi057.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-03-03T07:27:31.982 INFO:teuthology.orchestra.run.smithi057.stderr: * [new branch] main -> origin/main 2023-03-03T07:27:32.029 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20190312 -> 20190312 2023-03-03T07:27:32.029 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20190416 -> 20190416 2023-03-03T07:27:32.029 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20190514 -> 20190514 2023-03-03T07:27:32.030 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20190618 -> 20190618 2023-03-03T07:27:32.030 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20190717 -> 20190717 2023-03-03T07:27:32.030 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20190815 -> 20190815 2023-03-03T07:27:32.030 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20190923 -> 20190923 2023-03-03T07:27:32.032 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20191022 -> 20191022 2023-03-03T07:27:32.032 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20191215 -> 20191215 2023-03-03T07:27:32.032 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20200122 -> 20200122 2023-03-03T07:27:32.032 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20200316 -> 20200316 2023-03-03T07:27:32.032 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20200421 -> 20200421 2023-03-03T07:27:32.032 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20200519 -> 20200519 2023-03-03T07:27:32.033 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20200619 -> 20200619 2023-03-03T07:27:32.033 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20200721 -> 20200721 2023-03-03T07:27:32.033 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20200817 -> 20200817 2023-03-03T07:27:32.033 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20200918 -> 20200918 2023-03-03T07:27:32.033 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20201022 -> 20201022 2023-03-03T07:27:32.034 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20201118 -> 20201118 2023-03-03T07:27:32.034 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20201218 -> 20201218 2023-03-03T07:27:32.034 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20210208 -> 20210208 2023-03-03T07:27:32.034 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20210315 -> 20210315 2023-03-03T07:27:32.035 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20210511 -> 20210511 2023-03-03T07:27:32.035 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20210716 -> 20210716 2023-03-03T07:27:32.035 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20210818 -> 20210818 2023-03-03T07:27:32.036 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20210919 -> 20210919 2023-03-03T07:27:32.036 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20211027 -> 20211027 2023-03-03T07:27:32.036 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20211216 -> 20211216 2023-03-03T07:27:32.038 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20220209 -> 20220209 2023-03-03T07:27:32.039 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20220310 -> 20220310 2023-03-03T07:27:32.039 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20220411 -> 20220411 2023-03-03T07:27:32.039 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20220509 -> 20220509 2023-03-03T07:27:32.040 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20220610 -> 20220610 2023-03-03T07:27:32.040 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20220708 -> 20220708 2023-03-03T07:27:32.040 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20220815 -> 20220815 2023-03-03T07:27:32.040 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20220913 -> 20220913 2023-03-03T07:27:32.040 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20221012 -> 20221012 2023-03-03T07:27:32.040 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20221109 -> 20221109 2023-03-03T07:27:32.041 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20221214 -> 20221214 2023-03-03T07:27:32.041 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20230117 -> 20230117 2023-03-03T07:27:32.041 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20230210 -> 20230210 2023-03-03T07:27:35.243 INFO:teuthology.orchestra.run.smithi057.stderr:Updating files: 50% (1432/2860) Updating files: 51% (1459/2860) Updating files: 52% (1488/2860) Updating files: 53% (1516/2860) Updating files: 54% (1545/2860) Updating files: 55% (1573/2860) Updating files: 56% (1602/2860) Updating files: 57% (1631/2860) Updating files: 58% (1659/2860) Updating files: 59% (1688/2860) Updating files: 60% (1716/2860) Updating files: 61% (1745/2860) Updating files: 62% (1774/2860) Updating files: 63% (1802/2860) Updating files: 64% (1831/2860) Updating files: 64% (1857/2860) Updating files: 65% (1859/2860) Updating files: 66% (1888/2860) Updating files: 67% (1917/2860) Updating files: 68% (1945/2860) Updating files: 69% (1974/2860) Updating files: 70% (2002/2860) Updating files: 71% (2031/2860) Updating files: 72% (2060/2860) Updating files: 73% (2088/2860) Updating files: 74% (2117/2860) Updating files: 75% (2145/2860) Updating files: 76% (2174/2860) Updating files: 77% (2203/2860) Updating files: 78% (2231/2860) Updating files: 79% (2260/2860) Updating files: 80% (2288/2860) Updating files: 81% (2317/2860) Updating files: 82% (2346/2860) Updating files: 83% (2374/2860) Updating files: 84% (2403/2860) Updating files: 85% (2431/2860) Updating files: 86% (2460/2860) Updating files: 87% (2489/2860) Updating files: 88% (2517/2860) Updating files: 89% (2546/2860) Updating files: 90% (2574/2860) Updating files: 91% (2603/2860) Updating files: 92% (2632/2860) Updating files: 93% (2660/2860) Updating files: 94% (2689/2860) Updating files: 95% (2717/2860) Updating files: 96% (2746/2860) Updating files: 97% (2775/2860) Updating files: 98% (2803/2860) Updating files: 99% (2832/2860) Updating files: 100% (2860/2860) Updating files: 100% (2860/2860), done. 2023-03-03T07:27:35.247 INFO:teuthology.orchestra.run.smithi057.stdout:HEAD is now at 60971a6 Merge branch 'liquidio-20230222' of https://github.com/dchickles/linux-firmware 2023-03-03T07:27:35.262 INFO:teuthology.task.kernel:Downloading kernel 75534f74ac3dd06f86697ff862e8be2945b3c8e6 on mon.a... 2023-03-03T07:27:35.262 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=75534f74ac3dd06f86697ff862e8be2945b3c8e6 2023-03-03T07:27:35.410 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/75534f74ac3dd06f86697ff862e8be2945b3c8e6/ubuntu/focal/flavors/default/pool/main/l/linux-6.2.0-ceph-g75534f74ac3d/ 2023-03-03T07:27:35.411 DEBUG:teuthology.orchestra.run.smithi057:> rm -f /tmp/linux-image.deb && echo linux-image-6.2.0-ceph-g75534f74ac3d_6.2.0-ceph-g75534f74ac3d-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://4.chacra.ceph.com/r/kernel/testing/75534f74ac3dd06f86697ff862e8be2945b3c8e6/ubuntu/focal/flavors/default/pool/main/l/linux-6.2.0-ceph-g75534f74ac3d/ --input-file=- 2023-03-03T07:27:35.413 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi057.front.sepia.ceph.com to complete... 2023-03-03T07:27:39.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03 07:27:39 URL:https://4.chacra.ceph.com/r/kernel/testing/75534f74ac3dd06f86697ff862e8be2945b3c8e6/ubuntu/focal/flavors/default/pool/main/l/linux-6.2.0-ceph-g75534f74ac3d/linux-image-6.2.0-ceph-g75534f74ac3d_6.2.0-ceph-g75534f74ac3d-1_amd64.deb [38944908/38944908] -> "/tmp/linux-image.deb" [1] 2023-03-03T07:27:39.145 INFO:teuthology.orchestra.run.smithi057.stderr:FINISHED --2023-03-03 07:27:39-- 2023-03-03T07:27:39.145 INFO:teuthology.orchestra.run.smithi057.stderr:Total wall clock time: 3.7s 2023-03-03T07:27:39.145 INFO:teuthology.orchestra.run.smithi057.stderr:Downloaded: 1 files, 37M in 3.6s (10.3 MB/s) 2023-03-03T07:27:39.146 INFO:teuthology.task.kernel:Installing kernel 75534f74ac3dd06f86697ff862e8be2945b3c8e6 on mon.a... 2023-03-03T07:27:39.147 DEBUG:teuthology.orchestra.run.smithi057:> sudo dpkg -i /tmp/linux-image.deb 2023-03-03T07:27:39.428 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package linux-image-6.2.0-ceph-g75534f74ac3d. 2023-03-03T07:27:41.183 INFO:teuthology.orchestra.run.smithi057.stdout:(Reading database ... 104373 files and directories currently installed.) 2023-03-03T07:27:41.188 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-03-03T07:27:41.326 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking linux-image-6.2.0-ceph-g75534f74ac3d (6.2.0-ceph-g75534f74ac3d-1) ... 2023-03-03T07:27:44.123 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up linux-image-6.2.0-ceph-g75534f74ac3d (6.2.0-ceph-g75534f74ac3d-1) ... 2023-03-03T07:27:44.241 INFO:teuthology.orchestra.run.smithi057.stderr:update-initramfs: Generating /boot/initrd.img-6.2.0-ceph-g75534f74ac3d 2023-03-03T07:28:08.538 INFO:teuthology.orchestra.run.smithi057.stderr:Sourcing file `/etc/default/grub' 2023-03-03T07:28:08.549 INFO:teuthology.orchestra.run.smithi057.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-03-03T07:28:08.581 INFO:teuthology.orchestra.run.smithi057.stderr:Generating grub configuration file ... 2023-03-03T07:28:08.905 INFO:teuthology.orchestra.run.smithi057.stderr:Found linux image: /boot/vmlinuz-6.2.0-ceph-g75534f74ac3d 2023-03-03T07:28:08.928 INFO:teuthology.orchestra.run.smithi057.stderr:Found initrd image: /boot/initrd.img-6.2.0-ceph-g75534f74ac3d 2023-03-03T07:28:09.361 INFO:teuthology.orchestra.run.smithi057.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-03-03T07:28:09.374 INFO:teuthology.orchestra.run.smithi057.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-03-03T07:28:12.017 INFO:teuthology.orchestra.run.smithi057.stderr:done 2023-03-03T07:28:12.170 DEBUG:teuthology.orchestra.run.smithi057:> dpkg-deb -c /tmp/linux-image.deb 2023-03-03T07:28:12.180 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./ 2023-03-03T07:28:12.180 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./boot/ 2023-03-03T07:28:12.181 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 4431288 2023-03-03 04:49 ./boot/System.map-6.2.0-ceph-g75534f74ac3d 2023-03-03T07:28:12.198 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 166345 2023-03-03 04:49 ./boot/config-6.2.0-ceph-g75534f74ac3d 2023-03-03T07:28:12.198 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11098304 2023-03-03 04:49 ./boot/vmlinuz-6.2.0-ceph-g75534f74ac3d 2023-03-03T07:28:12.217 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./etc/ 2023-03-03T07:28:12.218 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./etc/kernel/ 2023-03-03T07:28:12.218 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./etc/kernel/postinst.d/ 2023-03-03T07:28:12.218 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./etc/kernel/postrm.d/ 2023-03-03T07:28:12.218 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./etc/kernel/preinst.d/ 2023-03-03T07:28:12.219 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./etc/kernel/prerm.d/ 2023-03-03T07:28:12.219 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/ 2023-03-03T07:28:12.219 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/ 2023-03-03T07:28:12.219 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/ 2023-03-03T07:28:12.219 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/ 2023-03-03T07:28:12.220 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/ 2023-03-03T07:28:12.220 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/ 2023-03-03T07:28:12.220 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/crypto/ 2023-03-03T07:28:12.220 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 527801 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/crypto/aesni-intel.ko 2023-03-03T07:28:12.223 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24689 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-03-03T07:28:12.224 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28193 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-03-03T07:28:12.224 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29401 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-03-03T07:28:12.224 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 88369 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-03-03T07:28:12.224 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 100121 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-03-03T07:28:12.225 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 142161 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-03-03T07:28:12.225 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12249 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-03-03T07:28:12.225 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13281 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-03-03T07:28:12.226 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 78769 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-03-03T07:28:12.226 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18025 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-03-03T07:28:12.226 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 46297 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-03-03T07:28:12.227 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 46689 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/crypto/serpent-avx2.ko 2023-03-03T07:28:12.227 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 51305 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-03-03T07:28:12.227 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 37985 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-03-03T07:28:12.227 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 39841 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-03-03T07:28:12.227 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 58033 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-03-03T07:28:12.227 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 50049 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-03-03T07:28:12.227 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31089 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-03-03T07:28:12.228 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12761 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-03-03T07:28:12.228 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/kernel/ 2023-03-03T07:28:12.228 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/kernel/cpu/ 2023-03-03T07:28:12.228 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/kernel/cpu/mce/ 2023-03-03T07:28:12.228 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 41257 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-03-03T07:28:12.228 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12777 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/kernel/cpuid.ko 2023-03-03T07:28:12.228 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17617 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/kernel/msr.ko 2023-03-03T07:28:12.228 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/kvm/ 2023-03-03T07:28:12.229 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 344241 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/kvm/kvm-amd.ko 2023-03-03T07:28:12.229 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 912137 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/kvm/kvm-intel.ko 2023-03-03T07:28:12.229 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 2209417 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/kvm/kvm.ko 2023-03-03T07:28:12.236 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/ 2023-03-03T07:28:12.236 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 55745 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/af_alg.ko 2023-03-03T07:28:12.236 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24713 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/algif_hash.ko 2023-03-03T07:28:12.236 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20585 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/algif_skcipher.ko 2023-03-03T07:28:12.236 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18017 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/ansi_cprng.ko 2023-03-03T07:28:12.237 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19145 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/anubis.ko 2023-03-03T07:28:12.237 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9969 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/arc4.ko 2023-03-03T07:28:12.237 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/asymmetric_keys/ 2023-03-03T07:28:12.237 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10041 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-03-03T07:28:12.237 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/async_tx/ 2023-03-03T07:28:12.237 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10785 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/async_tx/async_memcpy.ko 2023-03-03T07:28:12.237 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18665 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/async_tx/async_pq.ko 2023-03-03T07:28:12.237 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20737 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/async_tx/async_raid6_recov.ko 2023-03-03T07:28:12.238 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13225 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/async_tx/async_tx.ko 2023-03-03T07:28:12.238 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16785 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/async_tx/async_xor.ko 2023-03-03T07:28:12.238 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16737 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/async_tx/raid6test.ko 2023-03-03T07:28:12.238 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19801 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/authenc.ko 2023-03-03T07:28:12.238 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22041 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/authencesn.ko 2023-03-03T07:28:12.238 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21017 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/blake2b_generic.ko 2023-03-03T07:28:12.238 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12009 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/blowfish_common.ko 2023-03-03T07:28:12.239 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10033 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/blowfish_generic.ko 2023-03-03T07:28:12.239 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 38377 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/camellia_generic.ko 2023-03-03T07:28:12.239 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26377 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/cast5_generic.ko 2023-03-03T07:28:12.239 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16721 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/cast6_generic.ko 2023-03-03T07:28:12.239 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9537 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/cast_common.ko 2023-03-03T07:28:12.239 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34665 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/ccm.ko 2023-03-03T07:28:12.239 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13897 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/cmac.ko 2023-03-03T07:28:12.239 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9089 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/crc32_generic.ko 2023-03-03T07:28:12.240 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 43297 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/cryptd.ko 2023-03-03T07:28:12.240 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23657 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/crypto_engine.ko 2023-03-03T07:28:12.240 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25313 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/crypto_simd.ko 2023-03-03T07:28:12.240 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24241 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/crypto_user.ko 2023-03-03T07:28:12.240 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17233 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/cts.ko 2023-03-03T07:28:12.240 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10417 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/des_generic.ko 2023-03-03T07:28:12.240 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14761 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/dh_generic.ko 2023-03-03T07:28:12.241 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10505 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/echainiv.ko 2023-03-03T07:28:12.241 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25321 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/essiv.ko 2023-03-03T07:28:12.241 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17489 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/fcrypt.ko 2023-03-03T07:28:12.241 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26393 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/khazad.ko 2023-03-03T07:28:12.241 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15217 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/lrw.ko 2023-03-03T07:28:12.241 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10985 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/lz4.ko 2023-03-03T07:28:12.241 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11001 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/lz4hc.ko 2023-03-03T07:28:12.242 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11257 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/md4.ko 2023-03-03T07:28:12.242 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9233 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/michael_mic.ko 2023-03-03T07:28:12.242 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10177 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/pcbc.ko 2023-03-03T07:28:12.242 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18329 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/pcrypt.ko 2023-03-03T07:28:12.242 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15553 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/rmd160.ko 2023-03-03T07:28:12.242 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28953 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/seed.ko 2023-03-03T07:28:12.242 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26049 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/serpent_generic.ko 2023-03-03T07:28:12.242 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 145489 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/tcrypt.ko 2023-03-03T07:28:12.243 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10377 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/tea.ko 2023-03-03T07:28:12.243 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27969 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/twofish_common.ko 2023-03-03T07:28:12.243 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12729 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/twofish_generic.ko 2023-03-03T07:28:12.243 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16897 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/vmac.ko 2023-03-03T07:28:12.243 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 35689 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/wp512.ko 2023-03-03T07:28:12.243 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13609 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/xcbc.ko 2023-03-03T07:28:12.243 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26025 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/xor.ko 2023-03-03T07:28:12.243 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18169 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/xts.ko 2023-03-03T07:28:12.244 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9049 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/xxhash_generic.ko 2023-03-03T07:28:12.244 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ 2023-03-03T07:28:12.244 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/acpi/ 2023-03-03T07:28:12.244 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18481 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/acpi/acpi_extlog.ko 2023-03-03T07:28:12.244 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26753 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/acpi/acpi_ipmi.ko 2023-03-03T07:28:12.244 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28801 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/acpi/acpi_pad.ko 2023-03-03T07:28:12.244 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/acpi/apei/ 2023-03-03T07:28:12.245 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30921 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/acpi/apei/einj.ko 2023-03-03T07:28:12.245 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12353 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/acpi/ec_sys.ko 2023-03-03T07:28:12.245 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13961 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/acpi/platform_profile.ko 2023-03-03T07:28:12.245 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24681 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/acpi/sbs.ko 2023-03-03T07:28:12.245 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18969 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/acpi/sbshc.ko 2023-03-03T07:28:12.245 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 99985 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/acpi/video.ko 2023-03-03T07:28:12.245 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/ 2023-03-03T07:28:12.246 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21609 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/acard-ahci.ko 2023-03-03T07:28:12.246 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 89905 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/ahci.ko 2023-03-03T07:28:12.246 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13681 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/ahci_platform.ko 2023-03-03T07:28:12.246 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 86265 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/libahci.ko 2023-03-03T07:28:12.246 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33057 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/libahci_platform.ko 2023-03-03T07:28:12.246 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16513 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_acpi.ko 2023-03-03T07:28:12.246 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30449 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_ali.ko 2023-03-03T07:28:12.247 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33505 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_amd.ko 2023-03-03T07:28:12.247 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20705 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_artop.ko 2023-03-03T07:28:12.247 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20561 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_atiixp.ko 2023-03-03T07:28:12.247 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24769 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_atp867x.ko 2023-03-03T07:28:12.247 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17409 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_cmd640.ko 2023-03-03T07:28:12.247 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25385 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_cmd64x.ko 2023-03-03T07:28:12.247 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14729 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_cypress.ko 2023-03-03T07:28:12.247 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17289 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_efar.ko 2023-03-03T07:28:12.248 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21697 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_hpt366.ko 2023-03-03T07:28:12.248 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34401 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_hpt37x.ko 2023-03-03T07:28:12.248 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23073 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_hpt3x2n.ko 2023-03-03T07:28:12.248 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16361 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_hpt3x3.ko 2023-03-03T07:28:12.248 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16433 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_it8213.ko 2023-03-03T07:28:12.248 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 35633 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_it821x.ko 2023-03-03T07:28:12.248 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12265 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_jmicron.ko 2023-03-03T07:28:12.248 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 50961 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_legacy.ko 2023-03-03T07:28:12.249 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14937 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_marvell.ko 2023-03-03T07:28:12.249 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15585 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_mpiix.ko 2023-03-03T07:28:12.249 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12209 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_netcell.ko 2023-03-03T07:28:12.249 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16185 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_ninja32.ko 2023-03-03T07:28:12.249 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14857 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_ns87410.ko 2023-03-03T07:28:12.249 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16737 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_ns87415.ko 2023-03-03T07:28:12.249 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15945 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_oldpiix.ko 2023-03-03T07:28:12.250 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14817 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_opti.ko 2023-03-03T07:28:12.250 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20809 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_optidma.ko 2023-03-03T07:28:12.250 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 32521 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_pcmcia.ko 2023-03-03T07:28:12.250 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 37953 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_pdc2027x.ko 2023-03-03T07:28:12.250 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19993 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-03-03T07:28:12.250 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13601 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_piccolo.ko 2023-03-03T07:28:12.250 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14889 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_radisys.ko 2023-03-03T07:28:12.250 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18953 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_rdc.ko 2023-03-03T07:28:12.251 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15369 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_rz1000.ko 2023-03-03T07:28:12.251 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13377 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_sch.ko 2023-03-03T07:28:12.251 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22873 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_serverworks.ko 2023-03-03T07:28:12.251 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23417 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_sil680.ko 2023-03-03T07:28:12.251 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19385 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_sl82c105.ko 2023-03-03T07:28:12.251 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15449 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_triflex.ko 2023-03-03T07:28:12.251 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30241 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_via.ko 2023-03-03T07:28:12.252 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22633 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pdc_adma.ko 2023-03-03T07:28:12.252 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29065 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/sata_inic162x.ko 2023-03-03T07:28:12.252 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 84481 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/sata_mv.ko 2023-03-03T07:28:12.252 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 72313 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/sata_nv.ko 2023-03-03T07:28:12.252 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 37225 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/sata_promise.ko 2023-03-03T07:28:12.252 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22849 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/sata_qstor.ko 2023-03-03T07:28:12.252 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29433 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/sata_sil.ko 2023-03-03T07:28:12.252 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 39241 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/sata_sil24.ko 2023-03-03T07:28:12.253 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17833 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/sata_sis.ko 2023-03-03T07:28:12.253 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19881 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/sata_svw.ko 2023-03-03T07:28:12.253 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 44289 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/sata_sx4.ko 2023-03-03T07:28:12.253 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14977 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/sata_uli.ko 2023-03-03T07:28:12.253 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 35689 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/sata_via.ko 2023-03-03T07:28:12.253 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20089 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/sata_vsc.ko 2023-03-03T07:28:12.253 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/auxdisplay/ 2023-03-03T07:28:12.253 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15545 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/auxdisplay/ks0108.ko 2023-03-03T07:28:12.254 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/bcma/ 2023-03-03T07:28:12.254 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 123145 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/bcma/bcma.ko 2023-03-03T07:28:12.254 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/block/ 2023-03-03T07:28:12.254 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/block/aoe/ 2023-03-03T07:28:12.254 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 115577 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/block/aoe/aoe.ko 2023-03-03T07:28:12.254 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/block/drbd/ 2023-03-03T07:28:12.254 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 980033 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/block/drbd/drbd.ko 2023-03-03T07:28:12.255 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 175665 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/block/floppy.ko 2023-03-03T07:28:12.255 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/block/mtip32xx/ 2023-03-03T07:28:12.255 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 97825 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-03-03T07:28:12.255 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 120025 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/block/nbd.ko 2023-03-03T07:28:12.255 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/block/null_blk/ 2023-03-03T07:28:12.255 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 111145 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/block/null_blk/null_blk.ko 2023-03-03T07:28:12.255 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 84001 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/block/pktcdvd.ko 2023-03-03T07:28:12.286 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 262345 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/block/rbd.ko 2023-03-03T07:28:12.287 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/block/xen-blkback/ 2023-03-03T07:28:12.287 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 100049 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-03-03T07:28:12.287 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/block/zram/ 2023-03-03T07:28:12.287 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 64345 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/block/zram/zram.ko 2023-03-03T07:28:12.287 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/ 2023-03-03T07:28:12.287 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30825 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/applicom.ko 2023-03-03T07:28:12.287 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11889 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/hangcheck-timer.ko 2023-03-03T07:28:12.288 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/hw_random/ 2023-03-03T07:28:12.288 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13369 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/hw_random/amd-rng.ko 2023-03-03T07:28:12.288 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17681 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/hw_random/intel-rng.ko 2023-03-03T07:28:12.288 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13281 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-03-03T07:28:12.288 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10393 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/hw_random/via-rng.ko 2023-03-03T07:28:12.288 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15025 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/hw_random/virtio-rng.ko 2023-03-03T07:28:12.288 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/ipmi/ 2023-03-03T07:28:12.289 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30561 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-03-03T07:28:12.289 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 150129 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-03-03T07:28:12.289 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26297 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-03-03T07:28:12.289 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 142969 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/ipmi/ipmi_si.ko 2023-03-03T07:28:12.289 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 71737 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-03-03T07:28:12.289 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 54273 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-03-03T07:28:12.289 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 36849 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/lp.ko 2023-03-03T07:28:12.290 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/mwave/ 2023-03-03T07:28:12.290 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 91993 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/mwave/mwave.ko 2023-03-03T07:28:12.290 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25081 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/nvram.ko 2023-03-03T07:28:12.290 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/pcmcia/ 2023-03-03T07:28:12.290 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 102753 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/pcmcia/cm4000_cs.ko 2023-03-03T07:28:12.290 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 51209 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/pcmcia/cm4040_cs.ko 2023-03-03T07:28:12.290 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 90025 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/pcmcia/synclink_cs.ko 2023-03-03T07:28:12.290 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 32145 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/ppdev.ko 2023-03-03T07:28:12.291 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 50905 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/tlclk.ko 2023-03-03T07:28:12.291 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/tpm/ 2023-03-03T07:28:12.291 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15897 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/tpm/tpm_atmel.ko 2023-03-03T07:28:12.291 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15625 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-03-03T07:28:12.291 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23857 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-03-03T07:28:12.291 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34289 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-03-03T07:28:12.291 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27137 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/tpm/tpm_infineon.ko 2023-03-03T07:28:12.291 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22433 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/tpm/tpm_nsc.ko 2023-03-03T07:28:12.292 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23137 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-03-03T07:28:12.292 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/xillybus/ 2023-03-03T07:28:12.292 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16721 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/xillybus/xillybus_class.ko 2023-03-03T07:28:12.292 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 51705 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/xillybus/xillybus_core.ko 2023-03-03T07:28:12.292 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12305 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-03-03T07:28:12.292 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/clk/ 2023-03-03T07:28:12.292 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12473 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/clk/clk-palmas.ko 2023-03-03T07:28:12.293 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 49969 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/clk/clk-si5351.ko 2023-03-03T07:28:12.293 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11257 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/clk/clk-twl6040.ko 2023-03-03T07:28:12.293 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19649 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/clk/clk-wm831x.ko 2023-03-03T07:28:12.293 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/cpufreq/ 2023-03-03T07:28:12.293 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9641 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-03-03T07:28:12.293 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16873 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/cpufreq/p4-clockmod.ko 2023-03-03T07:28:12.293 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25369 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/cpufreq/speedstep-lib.ko 2023-03-03T07:28:12.294 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/crypto/ 2023-03-03T07:28:12.294 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/crypto/ccp/ 2023-03-03T07:28:12.294 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 70649 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-03-03T07:28:12.294 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 225865 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/crypto/ccp/ccp.ko 2023-03-03T07:28:12.294 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19417 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/crypto/padlock-aes.ko 2023-03-03T07:28:12.294 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21057 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/crypto/padlock-sha.ko 2023-03-03T07:28:12.294 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/crypto/qat/ 2023-03-03T07:28:12.294 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/crypto/qat/qat_common/ 2023-03-03T07:28:12.295 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 415785 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/crypto/qat/qat_common/intel_qat.ko 2023-03-03T07:28:12.295 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/crypto/qat/qat_dh895xcc/ 2023-03-03T07:28:12.295 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24993 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/crypto/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-03-03T07:28:12.295 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/crypto/virtio/ 2023-03-03T07:28:12.295 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 71609 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-03-03T07:28:12.295 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/dca/ 2023-03-03T07:28:12.295 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28441 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/dca/dca.ko 2023-03-03T07:28:12.295 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/dma/ 2023-03-03T07:28:12.296 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/dma/dw/ 2023-03-03T07:28:12.296 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15705 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/dma/dw/dw_dmac.ko 2023-03-03T07:28:12.296 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/dma/ioat/ 2023-03-03T07:28:12.296 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 124625 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/dma/ioat/ioatdma.ko 2023-03-03T07:28:12.296 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/edac/ 2023-03-03T07:28:12.296 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 74129 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/edac/amd64_edac.ko 2023-03-03T07:28:12.296 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 37129 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/edac/e752x_edac.ko 2023-03-03T07:28:12.297 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 65753 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/edac/edac_mce_amd.ko 2023-03-03T07:28:12.297 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16897 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/edac/i3000_edac.ko 2023-03-03T07:28:12.297 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16633 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/edac/i3200_edac.ko 2023-03-03T07:28:12.297 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22417 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/edac/i5100_edac.ko 2023-03-03T07:28:12.297 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26033 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/edac/i5400_edac.ko 2023-03-03T07:28:12.297 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25009 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/edac/i7300_edac.ko 2023-03-03T07:28:12.297 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 52561 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/edac/i7core_edac.ko 2023-03-03T07:28:12.297 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17577 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/edac/i82975x_edac.ko 2023-03-03T07:28:12.298 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19377 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/edac/ie31200_edac.ko 2023-03-03T07:28:12.298 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 54409 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/edac/sb_edac.ko 2023-03-03T07:28:12.298 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16257 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/edac/x38_edac.ko 2023-03-03T07:28:12.298 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/extcon/ 2023-03-03T07:28:12.298 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12529 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/extcon/extcon-gpio.ko 2023-03-03T07:28:12.298 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27841 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/extcon/extcon-max14577.ko 2023-03-03T07:28:12.298 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28809 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/extcon/extcon-max77693.ko 2023-03-03T07:28:12.298 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26313 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/extcon/extcon-max8997.ko 2023-03-03T07:28:12.299 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26937 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/extcon/extcon-palmas.ko 2023-03-03T07:28:12.299 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24505 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/extcon/extcon-rt8973a.ko 2023-03-03T07:28:12.299 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28649 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/extcon/extcon-sm5502.ko 2023-03-03T07:28:12.299 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/firmware/ 2023-03-03T07:28:12.299 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33753 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/firmware/dmi-sysfs.ko 2023-03-03T07:28:12.299 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/firmware/efi/ 2023-03-03T07:28:12.299 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15057 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/firmware/efi/efi-pstore.ko 2023-03-03T07:28:12.300 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20209 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/firmware/iscsi_ibft.ko 2023-03-03T07:28:12.300 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/gpio/ 2023-03-03T07:28:12.300 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12425 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/gpio/gpio-adp5520.ko 2023-03-03T07:28:12.300 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19641 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/gpio/gpio-amd8111.ko 2023-03-03T07:28:12.300 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15049 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/gpio/gpio-arizona.ko 2023-03-03T07:28:12.300 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13745 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/gpio/gpio-da9052.ko 2023-03-03T07:28:12.300 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11433 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/gpio/gpio-da9055.ko 2023-03-03T07:28:12.300 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22409 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/gpio/gpio-dln2.ko 2023-03-03T07:28:12.301 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 78745 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/gpio/gpio-f7188x.ko 2023-03-03T07:28:12.301 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28377 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/gpio/gpio-generic.ko 2023-03-03T07:28:12.301 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19961 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/gpio/gpio-ich.ko 2023-03-03T07:28:12.301 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11641 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-03-03T07:28:12.301 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14017 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/gpio/gpio-kempld.ko 2023-03-03T07:28:12.301 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12185 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/gpio/gpio-lp3943.ko 2023-03-03T07:28:12.301 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9017 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/gpio/gpio-max7300.ko 2023-03-03T07:28:12.301 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11161 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/gpio/gpio-max730x.ko 2023-03-03T07:28:12.302 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18865 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/gpio/gpio-max732x.ko 2023-03-03T07:28:12.302 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25377 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-03-03T07:28:12.302 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 47001 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/gpio/gpio-pca953x.ko 2023-03-03T07:28:12.302 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21873 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/gpio/gpio-pcf857x.ko 2023-03-03T07:28:12.302 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14505 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/gpio/gpio-rdc321x.ko 2023-03-03T07:28:12.302 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20385 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/gpio/gpio-sch.ko 2023-03-03T07:28:12.302 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20017 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/gpio/gpio-sch311x.ko 2023-03-03T07:28:12.302 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11657 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/gpio/gpio-tps65912.ko 2023-03-03T07:28:12.303 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21897 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/gpio/gpio-twl4030.ko 2023-03-03T07:28:12.303 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11209 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/gpio/gpio-twl6040.ko 2023-03-03T07:28:12.303 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20497 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/gpio/gpio-viperboard.ko 2023-03-03T07:28:12.303 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15361 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/gpio/gpio-vx855.ko 2023-03-03T07:28:12.303 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16097 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/gpio/gpio-wm831x.ko 2023-03-03T07:28:12.303 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11121 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/gpio/gpio-wm8350.ko 2023-03-03T07:28:12.303 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16665 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/gpio/gpio-wm8994.ko 2023-03-03T07:28:12.303 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/ 2023-03-03T07:28:12.304 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11153 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-a4tech.ko 2023-03-03T07:28:12.304 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 39481 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-apple.ko 2023-03-03T07:28:12.304 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14201 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-appleir.ko 2023-03-03T07:28:12.304 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8153 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-aureal.ko 2023-03-03T07:28:12.304 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14505 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-axff.ko 2023-03-03T07:28:12.304 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10937 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-belkin.ko 2023-03-03T07:28:12.304 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10385 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-cherry.ko 2023-03-03T07:28:12.305 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17033 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-chicony.ko 2023-03-03T07:28:12.305 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 61537 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-cp2112.ko 2023-03-03T07:28:12.305 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10945 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-cypress.ko 2023-03-03T07:28:12.305 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15849 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-dr.ko 2023-03-03T07:28:12.305 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10841 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-elecom.ko 2023-03-03T07:28:12.305 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17545 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-elo.ko 2023-03-03T07:28:12.305 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12609 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-emsff.ko 2023-03-03T07:28:12.305 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10081 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-ezkey.ko 2023-03-03T07:28:12.306 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13273 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-gaff.ko 2023-03-03T07:28:12.306 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8793 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-generic.ko 2023-03-03T07:28:12.306 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16761 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-gt683r.ko 2023-03-03T07:28:12.306 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13393 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-gyration.ko 2023-03-03T07:28:12.306 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9345 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-holtek-kbd.ko 2023-03-03T07:28:12.306 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10313 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-holtek-mouse.ko 2023-03-03T07:28:12.306 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13337 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-holtekff.ko 2023-03-03T07:28:12.306 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19473 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-hyperv.ko 2023-03-03T07:28:12.307 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10313 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-icade.ko 2023-03-03T07:28:12.307 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9169 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-kensington.ko 2023-03-03T07:28:12.307 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8129 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-keytouch.ko 2023-03-03T07:28:12.307 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14345 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-kye.ko 2023-03-03T07:28:12.307 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11025 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-lcpower.ko 2023-03-03T07:28:12.307 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20401 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-led.ko 2023-03-03T07:28:12.307 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 50081 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-lenovo.ko 2023-03-03T07:28:12.308 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31097 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-lg-g15.ko 2023-03-03T07:28:12.308 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 53825 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-logitech-dj.ko 2023-03-03T07:28:12.308 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 89577 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-03-03T07:28:12.308 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 88385 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-logitech.ko 2023-03-03T07:28:12.308 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31241 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-magicmouse.ko 2023-03-03T07:28:12.308 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21953 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-microsoft.ko 2023-03-03T07:28:12.308 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10545 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-monterey.ko 2023-03-03T07:28:12.308 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 50889 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-multitouch.ko 2023-03-03T07:28:12.309 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 32969 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-ntrig.ko 2023-03-03T07:28:12.309 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8905 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-ortek.ko 2023-03-03T07:28:12.309 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9009 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-penmount.ko 2023-03-03T07:28:12.309 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12497 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-petalynx.ko 2023-03-03T07:28:12.309 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 71273 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-picolcd.ko 2023-03-03T07:28:12.309 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14577 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-pl.ko 2023-03-03T07:28:12.309 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14817 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-plantronics.ko 2023-03-03T07:28:12.309 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8209 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-primax.ko 2023-03-03T07:28:12.310 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 36425 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-rmi.ko 2023-03-03T07:28:12.310 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20841 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-roccat-arvo.ko 2023-03-03T07:28:12.310 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13129 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-roccat-common.ko 2023-03-03T07:28:12.310 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31329 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-roccat-isku.ko 2023-03-03T07:28:12.310 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30049 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-roccat-kone.ko 2023-03-03T07:28:12.310 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31041 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-03-03T07:28:12.310 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20913 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-roccat-konepure.ko 2023-03-03T07:28:12.311 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29505 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-03-03T07:28:12.311 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12913 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-roccat-lua.ko 2023-03-03T07:28:12.311 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29377 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-roccat-pyra.ko 2023-03-03T07:28:12.311 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27497 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-roccat-ryos.ko 2023-03-03T07:28:12.311 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19289 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-roccat-savu.ko 2023-03-03T07:28:12.311 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22785 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-roccat.ko 2023-03-03T07:28:12.311 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13361 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-saitek.ko 2023-03-03T07:28:12.311 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15129 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-samsung.ko 2023-03-03T07:28:12.312 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 36353 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-sensor-hub.ko 2023-03-03T07:28:12.312 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13705 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-sjoy.ko 2023-03-03T07:28:12.312 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 72945 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-sony.ko 2023-03-03T07:28:12.312 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7817 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-speedlink.ko 2023-03-03T07:28:12.312 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15593 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-steelseries.ko 2023-03-03T07:28:12.312 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9841 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-sunplus.ko 2023-03-03T07:28:12.312 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16721 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-thrustmaster.ko 2023-03-03T07:28:12.312 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10721 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-tivo.ko 2023-03-03T07:28:12.313 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14649 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-tmff.ko 2023-03-03T07:28:12.313 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15657 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-topseed.ko 2023-03-03T07:28:12.313 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18041 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-twinhan.ko 2023-03-03T07:28:12.313 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 68433 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-uclogic.ko 2023-03-03T07:28:12.313 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10433 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-waltop.ko 2023-03-03T07:28:12.313 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 145113 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-wiimote.ko 2023-03-03T07:28:12.313 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7657 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-xinmo.ko 2023-03-03T07:28:12.314 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11897 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-zpff.ko 2023-03-03T07:28:12.314 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16281 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-zydacron.ko 2023-03-03T07:28:12.314 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 260569 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid.ko 2023-03-03T07:28:12.314 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 32713 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/uhid.ko 2023-03-03T07:28:12.314 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/usbhid/ 2023-03-03T07:28:12.314 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 126433 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/usbhid/usbhid.ko 2023-03-03T07:28:12.314 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19265 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/usbhid/usbkbd.ko 2023-03-03T07:28:12.314 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14721 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/usbhid/usbmouse.ko 2023-03-03T07:28:12.315 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 218593 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/wacom.ko 2023-03-03T07:28:12.315 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hv/ 2023-03-03T07:28:12.315 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 65753 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hv/hv_balloon.ko 2023-03-03T07:28:12.315 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 92873 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hv/hv_utils.ko 2023-03-03T07:28:12.315 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 309889 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hv/hv_vmbus.ko 2023-03-03T07:28:12.315 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/ 2023-03-03T07:28:12.315 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 66545 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/abituguru.ko 2023-03-03T07:28:12.315 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 61041 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/abituguru3.ko 2023-03-03T07:28:12.316 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34905 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/acpi_power_meter.ko 2023-03-03T07:28:12.316 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17441 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/ad7414.ko 2023-03-03T07:28:12.316 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19177 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/ad7418.ko 2023-03-03T07:28:12.316 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24833 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/adc128d818.ko 2023-03-03T07:28:12.316 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31233 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/adm1025.ko 2023-03-03T07:28:12.316 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 98161 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/adm1026.ko 2023-03-03T07:28:12.316 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19441 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/adm1029.ko 2023-03-03T07:28:12.316 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 45057 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/adm1031.ko 2023-03-03T07:28:12.317 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26361 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/adm9240.ko 2023-03-03T07:28:12.317 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14337 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/ads7828.ko 2023-03-03T07:28:12.317 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10337 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/adt7410.ko 2023-03-03T07:28:12.317 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21617 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/adt7411.ko 2023-03-03T07:28:12.317 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 74009 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/adt7462.ko 2023-03-03T07:28:12.317 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 39153 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/adt7470.ko 2023-03-03T07:28:12.317 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 65281 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/adt7475.ko 2023-03-03T07:28:12.318 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18729 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/adt7x10.ko 2023-03-03T07:28:12.318 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 41385 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/amc6821.ko 2023-03-03T07:28:12.318 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 55129 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/applesmc.ko 2023-03-03T07:28:12.318 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 49961 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/asb100.ko 2023-03-03T07:28:12.318 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 60905 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/asc7621.ko 2023-03-03T07:28:12.318 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 41785 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/asus_atk0110.ko 2023-03-03T07:28:12.318 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17417 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/atxp1.ko 2023-03-03T07:28:12.318 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29937 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/coretemp.ko 2023-03-03T07:28:12.319 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24169 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/da9052-hwmon.ko 2023-03-03T07:28:12.319 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17105 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/da9055-hwmon.ko 2023-03-03T07:28:12.319 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 43417 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-03-03T07:28:12.319 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 106217 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/dme1737.ko 2023-03-03T07:28:12.319 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19049 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/ds1621.ko 2023-03-03T07:28:12.319 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14897 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/ds620.ko 2023-03-03T07:28:12.319 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29649 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/emc1403.ko 2023-03-03T07:28:12.319 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34033 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/emc2103.ko 2023-03-03T07:28:12.320 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30849 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/emc6w201.ko 2023-03-03T07:28:12.320 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 66649 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/f71805f.ko 2023-03-03T07:28:12.320 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 94609 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/f71882fg.ko 2023-03-03T07:28:12.320 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 40969 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/f75375s.ko 2023-03-03T07:28:12.320 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21393 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/fam15h_power.ko 2023-03-03T07:28:12.320 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 55633 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/fschmd.ko 2023-03-03T07:28:12.320 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14057 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/g760a.ko 2023-03-03T07:28:12.321 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23593 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/g762.ko 2023-03-03T07:28:12.321 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 46705 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/gl518sm.ko 2023-03-03T07:28:12.321 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 45433 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/gl520sm.ko 2023-03-03T07:28:12.321 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13289 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/hih6130.ko 2023-03-03T07:28:12.321 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9585 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/hwmon-vid.ko 2023-03-03T07:28:12.321 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11417 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/i5500_temp.ko 2023-03-03T07:28:12.321 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22337 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/i5k_amb.ko 2023-03-03T07:28:12.321 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 35505 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/ibmaem.ko 2023-03-03T07:28:12.322 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21561 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/ibmpex.ko 2023-03-03T07:28:12.322 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24441 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/ina209.ko 2023-03-03T07:28:12.322 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28041 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/ina2xx.ko 2023-03-03T07:28:12.322 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 118873 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/it87.ko 2023-03-03T07:28:12.322 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18409 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/jc42.ko 2023-03-03T07:28:12.322 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23665 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/k10temp.ko 2023-03-03T07:28:12.322 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13601 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/k8temp.ko 2023-03-03T07:28:12.322 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19257 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/lineage-pem.ko 2023-03-03T07:28:12.323 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 48529 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/lm63.ko 2023-03-03T07:28:12.323 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16793 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/lm73.ko 2023-03-03T07:28:12.323 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 36537 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/lm75.ko 2023-03-03T07:28:12.323 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19049 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/lm77.ko 2023-03-03T07:28:12.323 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34585 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/lm78.ko 2023-03-03T07:28:12.323 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31649 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/lm80.ko 2023-03-03T07:28:12.323 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16457 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/lm83.ko 2023-03-03T07:28:12.324 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 72785 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/lm85.ko 2023-03-03T07:28:12.324 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 45633 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/lm87.ko 2023-03-03T07:28:12.324 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 37409 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/lm90.ko 2023-03-03T07:28:12.324 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19625 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/lm92.ko 2023-03-03T07:28:12.324 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 112985 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/lm93.ko 2023-03-03T07:28:12.324 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33273 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/lm95234.ko 2023-03-03T07:28:12.324 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15769 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/lm95241.ko 2023-03-03T07:28:12.324 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17673 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/lm95245.ko 2023-03-03T07:28:12.325 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22441 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/ltc2945.ko 2023-03-03T07:28:12.325 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13369 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/ltc4151.ko 2023-03-03T07:28:12.325 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14761 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/ltc4215.ko 2023-03-03T07:28:12.325 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14729 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/ltc4222.ko 2023-03-03T07:28:12.325 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14401 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/ltc4245.ko 2023-03-03T07:28:12.325 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13033 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/ltc4260.ko 2023-03-03T07:28:12.325 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14873 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/ltc4261.ko 2023-03-03T07:28:12.325 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33057 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/max16065.ko 2023-03-03T07:28:12.326 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18337 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/max1619.ko 2023-03-03T07:28:12.326 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23913 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/max1668.ko 2023-03-03T07:28:12.326 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19905 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/max197.ko 2023-03-03T07:28:12.326 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26185 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/max6639.ko 2023-03-03T07:28:12.326 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23265 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/max6650.ko 2023-03-03T07:28:12.326 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 35337 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/max6697.ko 2023-03-03T07:28:12.326 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17849 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/mc13783-adc.ko 2023-03-03T07:28:12.326 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10089 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/mcp3021.ko 2023-03-03T07:28:12.327 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15625 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-03-03T07:28:12.327 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 43529 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/nct6683.ko 2023-03-03T07:28:12.327 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 114801 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/nct6775-core.ko 2023-03-03T07:28:12.327 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 41001 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/nct6775.ko 2023-03-03T07:28:12.327 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 59233 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/nct7802.ko 2023-03-03T07:28:12.327 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 81465 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/pc87360.ko 2023-03-03T07:28:12.327 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 53945 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/pc87427.ko 2023-03-03T07:28:12.328 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18033 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/pcf8591.ko 2023-03-03T07:28:12.328 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/pmbus/ 2023-03-03T07:28:12.328 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21385 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-03-03T07:28:12.328 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16569 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-03-03T07:28:12.328 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28321 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-03-03T07:28:12.328 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9081 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/pmbus/max16064.ko 2023-03-03T07:28:12.328 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17233 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/pmbus/max34440.ko 2023-03-03T07:28:12.328 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9681 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/pmbus/max8688.ko 2023-03-03T07:28:12.329 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15081 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-03-03T07:28:12.329 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 72265 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-03-03T07:28:12.329 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8241 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-03-03T07:28:12.329 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26801 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-03-03T07:28:12.329 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14985 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-03-03T07:28:12.329 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20713 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-03-03T07:28:12.329 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12529 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/powr1220.ko 2023-03-03T07:28:12.329 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18801 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/sch5627.ko 2023-03-03T07:28:12.330 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28809 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/sch5636.ko 2023-03-03T07:28:12.330 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26177 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/sch56xx-common.ko 2023-03-03T07:28:12.330 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 32337 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/sht15.ko 2023-03-03T07:28:12.330 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13417 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/sht21.ko 2023-03-03T07:28:12.330 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17145 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/shtc1.ko 2023-03-03T07:28:12.330 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 40585 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/sis5595.ko 2023-03-03T07:28:12.330 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31497 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/smm665.ko 2023-03-03T07:28:12.331 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19305 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/smsc47b397.ko 2023-03-03T07:28:12.331 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 38185 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/smsc47m1.ko 2023-03-03T07:28:12.331 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 37273 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/smsc47m192.ko 2023-03-03T07:28:12.331 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26057 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/thmc50.ko 2023-03-03T07:28:12.331 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16993 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/tmp102.ko 2023-03-03T07:28:12.331 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13721 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/tmp103.ko 2023-03-03T07:28:12.331 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21105 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/tmp401.ko 2023-03-03T07:28:12.331 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18713 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/tmp421.ko 2023-03-03T07:28:12.332 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19449 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/via-cputemp.ko 2023-03-03T07:28:12.332 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 42289 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/via686a.ko 2023-03-03T07:28:12.332 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 52889 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/vt1211.ko 2023-03-03T07:28:12.332 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 52009 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/vt8231.ko 2023-03-03T07:28:12.332 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 57337 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/w83627ehf.ko 2023-03-03T07:28:12.332 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 79145 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/w83627hf.ko 2023-03-03T07:28:12.332 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 72073 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/w83781d.ko 2023-03-03T07:28:12.333 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 63177 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/w83791d.ko 2023-03-03T07:28:12.333 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 71273 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/w83792d.ko 2023-03-03T07:28:12.333 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 101769 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/w83793.ko 2023-03-03T07:28:12.333 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 119897 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/w83795.ko 2023-03-03T07:28:12.333 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16905 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/w83l785ts.ko 2023-03-03T07:28:12.333 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 35185 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/w83l786ng.ko 2023-03-03T07:28:12.333 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13393 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-03-03T07:28:12.333 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10201 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-03-03T07:28:12.334 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/ 2023-03-03T07:28:12.334 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/algos/ 2023-03-03T07:28:12.334 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20673 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-03-03T07:28:12.334 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20169 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-03-03T07:28:12.334 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/ 2023-03-03T07:28:12.334 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28473 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-03-03T07:28:12.334 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29481 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-03-03T07:28:12.334 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28265 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-03-03T07:28:12.335 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17377 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-03-03T07:28:12.335 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26297 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-03-03T07:28:12.335 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16105 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-03-03T07:28:12.335 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14657 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-03-03T07:28:12.335 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 6201 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-03-03T07:28:12.335 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14057 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-03-03T07:28:12.335 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 47961 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-03-03T07:28:12.336 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23577 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-03-03T07:28:12.336 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19473 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-03-03T07:28:12.336 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17273 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-03-03T07:28:12.336 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12273 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-03-03T07:28:12.336 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15817 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-03-03T07:28:12.336 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 62873 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-i801.ko 2023-03-03T07:28:12.336 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22417 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-isch.ko 2023-03-03T07:28:12.336 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 47569 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-03-03T07:28:12.337 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17233 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-03-03T07:28:12.337 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17321 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-03-03T07:28:12.337 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22441 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-03-03T07:28:12.337 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26521 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-03-03T07:28:12.337 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25225 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-parport.ko 2023-03-03T07:28:12.337 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16289 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-03-03T07:28:12.337 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 48601 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-03-03T07:28:12.337 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14713 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-03-03T07:28:12.338 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18897 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-03-03T07:28:12.338 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11793 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-03-03T07:28:12.338 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22777 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-03-03T07:28:12.338 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29769 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-03-03T07:28:12.338 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20313 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-03-03T07:28:12.338 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19473 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-03-03T07:28:12.338 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19873 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-03-03T07:28:12.338 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13721 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-via.ko 2023-03-03T07:28:12.339 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26569 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-03-03T07:28:12.339 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19561 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-03-03T07:28:12.339 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 39025 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-03-03T07:28:12.339 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21913 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/i2c-mux.ko 2023-03-03T07:28:12.339 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18729 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/i2c-smbus.ko 2023-03-03T07:28:12.339 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26369 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/i2c-stub.ko 2023-03-03T07:28:12.339 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/muxes/ 2023-03-03T07:28:12.340 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14889 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-03-03T07:28:12.340 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13241 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-03-03T07:28:12.340 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26953 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-03-03T07:28:12.340 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/ 2023-03-03T07:28:12.340 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/core/ 2023-03-03T07:28:12.340 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 274945 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/core/ib_cm.ko 2023-03-03T07:28:12.340 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 863201 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/core/ib_core.ko 2023-03-03T07:28:12.340 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 70465 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/core/ib_umad.ko 2023-03-03T07:28:12.341 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 321169 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-03-03T07:28:12.341 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 100529 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/core/iw_cm.ko 2023-03-03T07:28:12.341 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 276617 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/core/rdma_cm.ko 2023-03-03T07:28:12.341 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 65433 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-03-03T07:28:12.341 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/hw/ 2023-03-03T07:28:12.341 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/hw/cxgb4/ 2023-03-03T07:28:12.341 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 499489 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-03-03T07:28:12.342 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/hw/mlx4/ 2023-03-03T07:28:12.342 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 425945 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-03-03T07:28:12.342 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/hw/mlx5/ 2023-03-03T07:28:12.342 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 734337 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-03-03T07:28:12.342 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/hw/mthca/ 2023-03-03T07:28:12.342 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 302809 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-03-03T07:28:12.342 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/hw/ocrdma/ 2023-03-03T07:28:12.342 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 157289 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-03-03T07:28:12.343 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/hw/usnic/ 2023-03-03T07:28:12.343 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 178337 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-03-03T07:28:12.343 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/ulp/ 2023-03-03T07:28:12.343 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/ulp/ipoib/ 2023-03-03T07:28:12.343 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 272561 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-03-03T07:28:12.343 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/ulp/iser/ 2023-03-03T07:28:12.343 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 106273 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-03-03T07:28:12.344 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/ulp/isert/ 2023-03-03T07:28:12.344 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 119601 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-03-03T07:28:12.344 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/ulp/srp/ 2023-03-03T07:28:12.344 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 134625 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-03-03T07:28:12.344 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/ulp/srpt/ 2023-03-03T07:28:12.344 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 134249 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-03-03T07:28:12.344 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/ 2023-03-03T07:28:12.344 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10353 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/evbug.ko 2023-03-03T07:28:12.345 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23905 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/ff-memless.ko 2023-03-03T07:28:12.345 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/gameport/ 2023-03-03T07:28:12.345 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11801 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-03-03T07:28:12.345 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12009 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/gameport/fm801-gp.ko 2023-03-03T07:28:12.345 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 40313 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/gameport/gameport.ko 2023-03-03T07:28:12.345 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12185 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/gameport/lightning.ko 2023-03-03T07:28:12.345 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16985 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/gameport/ns558.ko 2023-03-03T07:28:12.345 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 41361 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/joydev.ko 2023-03-03T07:28:12.346 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/keyboard/ 2023-03-03T07:28:12.346 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12929 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-03-03T07:28:12.346 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31425 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-03-03T07:28:12.346 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28481 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-03-03T07:28:12.346 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25281 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-03-03T07:28:12.346 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 37401 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/keyboard/gpio_keys.ko 2023-03-03T07:28:12.346 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18745 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-03-03T07:28:12.347 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21337 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/keyboard/lkkbd.ko 2023-03-03T07:28:12.347 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28785 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/keyboard/lm8323.ko 2023-03-03T07:28:12.347 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15105 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/keyboard/lm8333.ko 2023-03-03T07:28:12.347 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24361 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-03-03T07:28:12.347 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17993 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-03-03T07:28:12.347 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15561 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-03-03T07:28:12.347 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16153 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-03-03T07:28:12.347 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11305 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/keyboard/newtonkbd.ko 2023-03-03T07:28:12.348 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10521 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-03-03T07:28:12.348 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15049 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/keyboard/qt1070.ko 2023-03-03T07:28:12.348 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21633 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/keyboard/qt2160.ko 2023-03-03T07:28:12.348 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23945 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-03-03T07:28:12.348 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10993 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/keyboard/stowaway.ko 2023-03-03T07:28:12.348 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18193 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/keyboard/sunkbd.ko 2023-03-03T07:28:12.348 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20513 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-03-03T07:28:12.348 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16577 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-03-03T07:28:12.349 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17593 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-03-03T07:28:12.349 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11521 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/keyboard/xtkbd.ko 2023-03-03T07:28:12.349 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11401 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/matrix-keymap.ko 2023-03-03T07:28:12.349 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/mouse/ 2023-03-03T07:28:12.349 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 35353 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/mouse/appletouch.ko 2023-03-03T07:28:12.349 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34897 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/mouse/bcm5974.ko 2023-03-03T07:28:12.349 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 126353 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/mouse/cyapatp.ko 2023-03-03T07:28:12.350 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 95897 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/mouse/elan_i2c.ko 2023-03-03T07:28:12.350 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14121 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/mouse/gpio_mouse.ko 2023-03-03T07:28:12.350 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 346145 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/mouse/psmouse.ko 2023-03-03T07:28:12.350 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14561 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/mouse/sermouse.ko 2023-03-03T07:28:12.350 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23753 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-03-03T07:28:12.350 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22649 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/mouse/synaptics_usb.ko 2023-03-03T07:28:12.350 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16297 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/mouse/vsxxxaa.ko 2023-03-03T07:28:12.350 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/rmi4/ 2023-03-03T07:28:12.351 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 113481 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/rmi4/rmi_core.ko 2023-03-03T07:28:12.351 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/serio/ 2023-03-03T07:28:12.351 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11433 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/serio/altera_ps2.ko 2023-03-03T07:28:12.351 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16481 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/serio/arc_ps2.ko 2023-03-03T07:28:12.351 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15753 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/serio/ct82c710.ko 2023-03-03T07:28:12.351 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17433 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-03-03T07:28:12.351 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15337 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/serio/parkbd.ko 2023-03-03T07:28:12.352 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12785 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/serio/pcips2.ko 2023-03-03T07:28:12.352 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19993 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/serio/ps2mult.ko 2023-03-03T07:28:12.352 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24089 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/serio/serio_raw.ko 2023-03-03T07:28:12.352 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17441 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/serio/serport.ko 2023-03-03T07:28:12.352 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12233 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/sparse-keymap.ko 2023-03-03T07:28:12.352 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/iommu/ 2023-03-03T07:28:12.352 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/iommu/amd/ 2023-03-03T07:28:12.352 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 37505 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/iommu/amd/iommu_v2.ko 2023-03-03T07:28:12.353 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/leds/ 2023-03-03T07:28:12.353 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13497 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/leds/leds-88pm860x.ko 2023-03-03T07:28:12.353 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11393 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/leds/leds-adp5520.ko 2023-03-03T07:28:12.353 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 63609 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/leds/leds-bd2802.ko 2023-03-03T07:28:12.353 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25513 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/leds/leds-blinkm.ko 2023-03-03T07:28:12.353 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10177 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/leds/leds-da903x.ko 2023-03-03T07:28:12.353 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13041 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/leds/leds-da9052.ko 2023-03-03T07:28:12.353 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15465 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/leds/leds-gpio.ko 2023-03-03T07:28:12.354 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15873 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/leds/leds-lm3530.ko 2023-03-03T07:28:12.354 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30569 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/leds/leds-lm3533.ko 2023-03-03T07:28:12.354 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19961 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/leds/leds-lm355x.ko 2023-03-03T07:28:12.354 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19641 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/leds/leds-lm3642.ko 2023-03-03T07:28:12.354 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16329 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/leds/leds-lp3944.ko 2023-03-03T07:28:12.354 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11001 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/leds/leds-lp8788.ko 2023-03-03T07:28:12.354 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14857 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/leds/leds-max8997.ko 2023-03-03T07:28:12.354 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11297 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/leds/leds-mc13783.ko 2023-03-03T07:28:12.355 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12921 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/leds/leds-menf21bmc.ko 2023-03-03T07:28:12.355 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20713 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/leds/leds-pca9532.ko 2023-03-03T07:28:12.355 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20969 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/leds/leds-pca955x.ko 2023-03-03T07:28:12.355 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17601 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/leds/leds-pca963x.ko 2023-03-03T07:28:12.355 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33681 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/leds/leds-ss4200.ko 2023-03-03T07:28:12.355 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24369 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/leds/leds-tca6507.ko 2023-03-03T07:28:12.355 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15593 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/leds/leds-wm831x-status.ko 2023-03-03T07:28:12.356 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11793 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/leds/leds-wm8350.ko 2023-03-03T07:28:12.356 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/leds/trigger/ 2023-03-03T07:28:12.356 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9177 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-03-03T07:28:12.356 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10377 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-03-03T07:28:12.356 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8273 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-03-03T07:28:12.356 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7121 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-03-03T07:28:12.356 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15065 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2023-03-03T07:28:12.356 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13713 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-03-03T07:28:12.357 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13961 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-03-03T07:28:12.357 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11657 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-03-03T07:28:12.357 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13585 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-03-03T07:28:12.357 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/ 2023-03-03T07:28:12.357 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/bcache/ 2023-03-03T07:28:12.357 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 650041 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/bcache/bcache.ko 2023-03-03T07:28:12.357 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34337 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/dm-bio-prison.ko 2023-03-03T07:28:12.358 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 80177 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/dm-bufio.ko 2023-03-03T07:28:12.358 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 47649 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/dm-cache-smq.ko 2023-03-03T07:28:12.358 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 156121 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/dm-cache.ko 2023-03-03T07:28:12.358 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 109385 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/dm-crypt.ko 2023-03-03T07:28:12.358 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21625 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/dm-delay.ko 2023-03-03T07:28:12.358 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 56505 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/dm-era.ko 2023-03-03T07:28:12.358 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20017 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/dm-flakey.ko 2023-03-03T07:28:12.358 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 42265 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/dm-log-userspace.ko 2023-03-03T07:28:12.359 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33121 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/dm-log.ko 2023-03-03T07:28:12.359 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 50249 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/dm-mirror.ko 2023-03-03T07:28:12.359 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 77673 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/dm-multipath.ko 2023-03-03T07:28:12.359 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16313 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/dm-queue-length.ko 2023-03-03T07:28:12.359 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 72689 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/dm-raid.ko 2023-03-03T07:28:12.359 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34001 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/dm-region-hash.ko 2023-03-03T07:28:12.359 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15641 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/dm-round-robin.ko 2023-03-03T07:28:12.359 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16569 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/dm-service-time.ko 2023-03-03T07:28:12.360 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 111985 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/dm-snapshot.ko 2023-03-03T07:28:12.360 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20617 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/dm-switch.ko 2023-03-03T07:28:12.360 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 186137 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/dm-thin-pool.ko 2023-03-03T07:28:12.360 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 52785 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/dm-verity.ko 2023-03-03T07:28:12.360 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8129 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/dm-zero.ko 2023-03-03T07:28:12.360 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14601 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/faulty.ko 2023-03-03T07:28:12.360 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19681 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/linear.ko 2023-03-03T07:28:12.360 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 32473 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/multipath.ko 2023-03-03T07:28:12.361 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/persistent-data/ 2023-03-03T07:28:12.361 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 196865 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-03-03T07:28:12.361 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 38697 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/raid0.ko 2023-03-03T07:28:12.361 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 110553 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/raid1.ko 2023-03-03T07:28:12.361 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 156729 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/raid10.ko 2023-03-03T07:28:12.399 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 396433 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/raid456.ko 2023-03-03T07:28:12.399 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/message/ 2023-03-03T07:28:12.399 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/message/fusion/ 2023-03-03T07:28:12.399 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 180969 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/message/fusion/mptbase.ko 2023-03-03T07:28:12.399 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 69785 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/message/fusion/mptctl.ko 2023-03-03T07:28:12.400 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 46065 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/message/fusion/mptfc.ko 2023-03-03T07:28:12.400 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 37281 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/message/fusion/mptlan.ko 2023-03-03T07:28:12.400 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 134233 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/message/fusion/mptsas.ko 2023-03-03T07:28:12.400 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 79705 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/message/fusion/mptscsih.ko 2023-03-03T07:28:12.400 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 54881 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/message/fusion/mptspi.ko 2023-03-03T07:28:12.400 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/mfd/ 2023-03-03T07:28:12.400 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17809 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/mfd/88pm800.ko 2023-03-03T07:28:12.400 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12641 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/mfd/88pm805.ko 2023-03-03T07:28:12.401 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10633 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/mfd/88pm80x.ko 2023-03-03T07:28:12.401 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11497 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/mfd/arizona-i2c.ko 2023-03-03T07:28:12.401 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 127713 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/mfd/arizona.ko 2023-03-03T07:28:12.401 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11985 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/mfd/bcm590xx.ko 2023-03-03T07:28:12.401 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18009 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/mfd/cros_ec_dev.ko 2023-03-03T07:28:12.401 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34873 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/mfd/dln2.ko 2023-03-03T07:28:12.401 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14761 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/mfd/htc-pasic3.ko 2023-03-03T07:28:12.402 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16809 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/mfd/janz-cmodio.ko 2023-03-03T07:28:12.402 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 52433 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/mfd/kempld-core.ko 2023-03-03T07:28:12.402 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27681 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/mfd/lm3533-core.ko 2023-03-03T07:28:12.402 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14121 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-03-03T07:28:12.402 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12177 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/mfd/lp3943.ko 2023-03-03T07:28:12.402 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 55041 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/mfd/lpc_ich.ko 2023-03-03T07:28:12.402 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12049 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/mfd/lpc_sch.ko 2023-03-03T07:28:12.402 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17577 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/mfd/max8907.ko 2023-03-03T07:28:12.403 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27601 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/mfd/mc13xxx-core.ko 2023-03-03T07:28:12.403 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11665 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-03-03T07:28:12.403 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10881 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/mfd/menf21bmc.ko 2023-03-03T07:28:12.403 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16713 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/mfd/pcf50633-adc.ko 2023-03-03T07:28:12.403 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8009 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/mfd/pcf50633-gpio.ko 2023-03-03T07:28:12.403 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34337 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/mfd/pcf50633.ko 2023-03-03T07:28:12.403 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9913 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-03-03T07:28:12.404 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20089 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/mfd/retu-mfd.ko 2023-03-03T07:28:12.404 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 77817 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/mfd/si476x-core.ko 2023-03-03T07:28:12.404 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 48937 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/mfd/sm501.ko 2023-03-03T07:28:12.404 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19009 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-03-03T07:28:12.404 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 51129 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/mfd/tps65010.ko 2023-03-03T07:28:12.404 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9993 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/mfd/tps6507x.ko 2023-03-03T07:28:12.404 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13017 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/mfd/viperboard.ko 2023-03-03T07:28:12.404 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10409 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/mfd/vx855.ko 2023-03-03T07:28:12.405 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19249 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/mfd/wl1273-core.ko 2023-03-03T07:28:12.405 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 44361 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/mfd/wm8994.ko 2023-03-03T07:28:12.405 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/ 2023-03-03T07:28:12.405 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13577 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-03-03T07:28:12.405 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 48201 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/ad525x_dpot.ko 2023-03-03T07:28:12.405 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/altera-stapl/ 2023-03-03T07:28:12.405 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 47681 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-03-03T07:28:12.405 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18145 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/apds9802als.ko 2023-03-03T07:28:12.406 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 37057 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/apds990x.ko 2023-03-03T07:28:12.406 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 45617 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/bh1770glc.ko 2023-03-03T07:28:12.406 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/c2port/ 2023-03-03T07:28:12.406 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10577 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-03-03T07:28:12.406 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 35793 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/c2port/core.ko 2023-03-03T07:28:12.406 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/cb710/ 2023-03-03T07:28:12.406 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24505 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/cb710/cb710.ko 2023-03-03T07:28:12.407 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17793 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/ds1682.ko 2023-03-03T07:28:12.407 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8753 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/dummy-irq.ko 2023-03-03T07:28:12.407 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/echo/ 2023-03-03T07:28:12.407 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12409 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/echo/echo.ko 2023-03-03T07:28:12.407 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/eeprom/ 2023-03-03T07:28:12.407 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 37865 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/eeprom/at24.ko 2023-03-03T07:28:12.407 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14297 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/eeprom/eeprom.ko 2023-03-03T07:28:12.408 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13721 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-03-03T07:28:12.408 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13353 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/eeprom/max6875.ko 2023-03-03T07:28:12.408 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31673 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/enclosure.ko 2023-03-03T07:28:12.408 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/genwqe/ 2023-03-03T07:28:12.408 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 155889 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-03-03T07:28:12.408 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14225 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/hmc6352.ko 2023-03-03T07:28:12.408 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31369 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/hpilo.ko 2023-03-03T07:28:12.409 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/ibmasm/ 2023-03-03T07:28:12.409 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 73553 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-03-03T07:28:12.409 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19729 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/ics932s401.ko 2023-03-03T07:28:12.409 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21409 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/isl29003.ko 2023-03-03T07:28:12.409 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15361 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/isl29020.ko 2023-03-03T07:28:12.409 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/lis3lv02d/ 2023-03-03T07:28:12.409 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 41665 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-03-03T07:28:12.409 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13737 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-03-03T07:28:12.410 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/mei/ 2023-03-03T07:28:12.410 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 90217 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/mei/mei-me.ko 2023-03-03T07:28:12.410 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 58481 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/mei/mei-txe.ko 2023-03-03T07:28:12.410 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 312217 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/mei/mei.ko 2023-03-03T07:28:12.410 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31649 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/phantom.ko 2023-03-03T07:28:12.410 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/ti-st/ 2023-03-03T07:28:12.410 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 75801 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/ti-st/st_drv.ko 2023-03-03T07:28:12.411 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24193 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/tifm_7xx1.ko 2023-03-03T07:28:12.411 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27289 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/tifm_core.ko 2023-03-03T07:28:12.411 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18601 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/tsl2550.ko 2023-03-03T07:28:12.411 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 48009 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/vmw_balloon.ko 2023-03-03T07:28:12.411 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/vmw_vmci/ 2023-03-03T07:28:12.411 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 182801 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-03-03T07:28:12.411 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ 2023-03-03T07:28:12.411 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/bonding/ 2023-03-03T07:28:12.412 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 488953 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/bonding/bonding.ko 2023-03-03T07:28:12.412 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/dsa/ 2023-03-03T07:28:12.412 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/dsa/b53/ 2023-03-03T07:28:12.412 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 99881 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/dsa/b53/b53_common.ko 2023-03-03T07:28:12.412 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 40401 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/dsa/bcm-sf2.ko 2023-03-03T07:28:12.412 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14481 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/dsa/mv88e6060.ko 2023-03-03T07:28:12.412 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/dsa/mv88e6xxx/ 2023-03-03T07:28:12.412 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 445361 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-03-03T07:28:12.413 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16553 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/dummy.ko 2023-03-03T07:28:12.413 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17409 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/eql.ko 2023-03-03T07:28:12.413 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/ 2023-03-03T07:28:12.413 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/3com/ 2023-03-03T07:28:12.413 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 46025 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-03-03T07:28:12.413 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 42665 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-03-03T07:28:12.413 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 132169 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-03-03T07:28:12.414 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 69809 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-03-03T07:28:12.414 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/8390/ 2023-03-03T07:28:12.414 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 37425 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/8390/8390.ko 2023-03-03T07:28:12.414 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 60985 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-03-03T07:28:12.414 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27673 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-03-03T07:28:12.414 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 99553 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-03-03T07:28:12.414 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/adaptec/ 2023-03-03T07:28:12.414 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 56681 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-03-03T07:28:12.415 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/agere/ 2023-03-03T07:28:12.415 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 70457 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/agere/et131x.ko 2023-03-03T07:28:12.415 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/alteon/ 2023-03-03T07:28:12.415 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 60177 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-03-03T07:28:12.415 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/altera/ 2023-03-03T07:28:12.415 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 41361 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-03-03T07:28:12.415 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/amd/ 2023-03-03T07:28:12.415 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 55033 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-03-03T07:28:12.416 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 48641 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-03-03T07:28:12.416 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 90569 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-03-03T07:28:12.416 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/atheros/ 2023-03-03T07:28:12.416 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/atheros/alx/ 2023-03-03T07:28:12.416 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 99337 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-03-03T07:28:12.416 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-03-03T07:28:12.416 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 106705 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-03-03T07:28:12.416 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-03-03T07:28:12.417 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 91945 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-03-03T07:28:12.417 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/atheros/atlx/ 2023-03-03T07:28:12.417 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 82753 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-03-03T07:28:12.417 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 70193 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-03-03T07:28:12.417 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/broadcom/ 2023-03-03T07:28:12.417 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 79497 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-03-03T07:28:12.417 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 176809 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-03-03T07:28:12.418 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-03-03T07:28:12.418 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 1535233 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-03-03T07:28:12.418 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 130009 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-03-03T07:28:12.418 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/broadcom/genet/ 2023-03-03T07:28:12.418 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 133305 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-03-03T07:28:12.418 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 316225 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-03-03T07:28:12.418 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/brocade/ 2023-03-03T07:28:12.418 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/brocade/bna/ 2023-03-03T07:28:12.419 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 334513 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-03-03T07:28:12.419 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/chelsio/ 2023-03-03T07:28:12.419 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-03-03T07:28:12.419 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 194849 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-03-03T07:28:12.419 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-03-03T07:28:12.419 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 353761 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-03-03T07:28:12.419 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-03-03T07:28:12.420 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 1061553 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-03-03T07:28:12.420 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-03-03T07:28:12.420 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 169497 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-03-03T07:28:12.420 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-03-03T07:28:12.420 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34993 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-03-03T07:28:12.420 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/cisco/ 2023-03-03T07:28:12.420 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/cisco/enic/ 2023-03-03T07:28:12.420 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 209577 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-03-03T07:28:12.421 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/dec/ 2023-03-03T07:28:12.421 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/dec/tulip/ 2023-03-03T07:28:12.421 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 70929 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-03-03T07:28:12.421 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 63233 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-03-03T07:28:12.421 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 145593 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-03-03T07:28:12.421 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 52953 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-03-03T07:28:12.421 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 64153 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-03-03T07:28:12.421 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31745 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-03-03T07:28:12.422 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/dlink/ 2023-03-03T07:28:12.422 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 62081 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-03-03T07:28:12.422 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 64129 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-03-03T07:28:12.422 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 46289 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/dnet.ko 2023-03-03T07:28:12.422 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25473 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/ec_bhf.ko 2023-03-03T07:28:12.422 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/emulex/ 2023-03-03T07:28:12.422 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/emulex/benet/ 2023-03-03T07:28:12.423 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 290761 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-03-03T07:28:12.423 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 50433 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/ethoc.ko 2023-03-03T07:28:12.423 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/fujitsu/ 2023-03-03T07:28:12.423 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 45329 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-03-03T07:28:12.423 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/intel/ 2023-03-03T07:28:12.423 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 93185 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/intel/e100.ko 2023-03-03T07:28:12.423 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/intel/e1000/ 2023-03-03T07:28:12.423 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 300377 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-03-03T07:28:12.424 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/intel/e1000e/ 2023-03-03T07:28:12.424 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 588441 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-03-03T07:28:12.424 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/intel/fm10k/ 2023-03-03T07:28:12.424 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 250753 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-03-03T07:28:12.424 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/intel/i40e/ 2023-03-03T07:28:12.424 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 979137 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-03-03T07:28:12.424 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/intel/iavf/ 2023-03-03T07:28:12.424 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 320785 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-03-03T07:28:12.425 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/intel/igb/ 2023-03-03T07:28:12.425 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 524993 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-03-03T07:28:12.425 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/intel/igbvf/ 2023-03-03T07:28:12.425 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 92905 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-03-03T07:28:12.425 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/intel/ixgb/ 2023-03-03T07:28:12.425 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 126129 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/intel/ixgb/ixgb.ko 2023-03-03T07:28:12.425 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-03-03T07:28:12.426 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 747761 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-03-03T07:28:12.426 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-03-03T07:28:12.426 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 154305 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-03-03T07:28:12.426 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 89905 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/jme.ko 2023-03-03T07:28:12.426 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/marvell/ 2023-03-03T07:28:12.426 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21561 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-03-03T07:28:12.426 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 106553 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/marvell/skge.ko 2023-03-03T07:28:12.426 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 124961 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-03-03T07:28:12.427 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/mellanox/ 2023-03-03T07:28:12.427 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-03-03T07:28:12.427 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 745441 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-03-03T07:28:12.427 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 277625 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-03-03T07:28:12.427 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-03-03T07:28:12.427 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-03-03T07:28:12.427 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 1048833 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-03-03T07:28:12.427 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/micrel/ 2023-03-03T07:28:12.428 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 53225 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-03-03T07:28:12.428 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 41185 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-03-03T07:28:12.428 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19425 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-03-03T07:28:12.428 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 95801 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-03-03T07:28:12.428 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/myricom/ 2023-03-03T07:28:12.428 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-03-03T07:28:12.428 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 115409 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-03-03T07:28:12.428 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/natsemi/ 2023-03-03T07:28:12.429 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 76033 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-03-03T07:28:12.429 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 48761 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-03-03T07:28:12.429 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/neterion/ 2023-03-03T07:28:12.429 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 155121 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-03-03T07:28:12.429 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/nvidia/ 2023-03-03T07:28:12.429 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 143961 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-03-03T07:28:12.429 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/packetengines/ 2023-03-03T07:28:12.430 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 51305 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-03-03T07:28:12.430 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 43841 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-03-03T07:28:12.430 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/qlogic/ 2023-03-03T07:28:12.430 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-03-03T07:28:12.430 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 234649 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-03-03T07:28:12.430 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 91945 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-03-03T07:28:12.430 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-03-03T07:28:12.430 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 702361 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-03-03T07:28:12.431 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/rdc/ 2023-03-03T07:28:12.431 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 42513 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-03-03T07:28:12.431 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/realtek/ 2023-03-03T07:28:12.431 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 67177 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-03-03T07:28:12.431 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 85057 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-03-03T07:28:12.431 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29185 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/realtek/atp.ko 2023-03-03T07:28:12.431 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 187265 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-03-03T07:28:12.431 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/samsung/ 2023-03-03T07:28:12.432 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-03-03T07:28:12.432 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 104737 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-03-03T07:28:12.432 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/sfc/ 2023-03-03T07:28:12.432 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 848441 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-03-03T07:28:12.432 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/silan/ 2023-03-03T07:28:12.432 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 47449 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-03-03T07:28:12.432 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/sis/ 2023-03-03T07:28:12.432 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 56345 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/sis/sis190.ko 2023-03-03T07:28:12.433 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 64753 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/sis/sis900.ko 2023-03-03T07:28:12.433 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/smsc/ 2023-03-03T07:28:12.433 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 62217 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-03-03T07:28:12.433 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 67961 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-03-03T07:28:12.433 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 74297 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-03-03T07:28:12.433 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 69801 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-03-03T07:28:12.433 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/stmicro/ 2023-03-03T07:28:12.434 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-03-03T07:28:12.434 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13385 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-03-03T07:28:12.434 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 40097 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-03-03T07:28:12.434 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14129 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-03-03T07:28:12.434 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 476785 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-03-03T07:28:12.434 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/sun/ 2023-03-03T07:28:12.434 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 106641 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/sun/cassini.ko 2023-03-03T07:28:12.434 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 172713 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/sun/niu.ko 2023-03-03T07:28:12.435 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 68657 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/sun/sungem.ko 2023-03-03T07:28:12.435 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 86489 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-03-03T07:28:12.435 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/tehuti/ 2023-03-03T07:28:12.435 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 50841 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-03-03T07:28:12.435 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/ti/ 2023-03-03T07:28:12.435 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 90137 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/ti/tlan.ko 2023-03-03T07:28:12.435 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/via/ 2023-03-03T07:28:12.435 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 81801 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-03-03T07:28:12.436 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 85201 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-03-03T07:28:12.436 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/wiznet/ 2023-03-03T07:28:12.436 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 45801 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-03-03T07:28:12.436 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31041 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-03-03T07:28:12.436 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/xircom/ 2023-03-03T07:28:12.436 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 59425 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-03-03T07:28:12.436 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/fddi/ 2023-03-03T07:28:12.436 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 42529 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/fddi/defxx.ko 2023-03-03T07:28:12.437 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/fddi/skfp/ 2023-03-03T07:28:12.437 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 223521 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/fddi/skfp/skfp.ko 2023-03-03T07:28:12.437 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 82889 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/geneve.ko 2023-03-03T07:28:12.437 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/hyperv/ 2023-03-03T07:28:12.437 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 238937 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-03-03T07:28:12.437 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ieee802154/ 2023-03-03T07:28:12.437 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17921 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ieee802154/fakelb.ko 2023-03-03T07:28:12.438 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24113 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ifb.ko 2023-03-03T07:28:12.438 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ipvlan/ 2023-03-03T07:28:12.438 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 86849 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ipvlan/ipvlan.ko 2023-03-03T07:28:12.438 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 60857 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/macvlan.ko 2023-03-03T07:28:12.438 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15385 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/macvtap.ko 2023-03-03T07:28:12.438 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/mdio/ 2023-03-03T07:28:12.438 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19425 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-03-03T07:28:12.438 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10897 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-03-03T07:28:12.439 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13585 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/mdio/mdio-gpio.ko 2023-03-03T07:28:12.439 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14729 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/mdio.ko 2023-03-03T07:28:12.439 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19409 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/mii.ko 2023-03-03T07:28:12.439 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 42377 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/netconsole.ko 2023-03-03T07:28:12.439 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12993 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/nlmon.ko 2023-03-03T07:28:12.439 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/pcs/ 2023-03-03T07:28:12.439 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9097 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/pcs/pcs-altera-tse.ko 2023-03-03T07:28:12.439 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30777 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-03-03T07:28:12.440 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/phy/ 2023-03-03T07:28:12.440 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9177 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/phy/amd.ko 2023-03-03T07:28:12.440 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 40009 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-03-03T07:28:12.440 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 44209 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/phy/bcm7xxx.ko 2023-03-03T07:28:12.440 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10905 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/phy/bcm87xx.ko 2023-03-03T07:28:12.440 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 36769 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/phy/broadcom.ko 2023-03-03T07:28:12.440 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10009 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/phy/cicada.ko 2023-03-03T07:28:12.440 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12281 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/phy/davicom.ko 2023-03-03T07:28:12.441 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8953 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/phy/et1011c.ko 2023-03-03T07:28:12.441 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24593 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/phy/icplus.ko 2023-03-03T07:28:12.441 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15097 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/phy/lxt.ko 2023-03-03T07:28:12.441 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 75921 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/phy/marvell.ko 2023-03-03T07:28:12.441 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 59753 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/phy/micrel.ko 2023-03-03T07:28:12.441 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11481 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/phy/national.ko 2023-03-03T07:28:12.441 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 94009 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/phy/phylink.ko 2023-03-03T07:28:12.442 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9505 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/phy/qsemi.ko 2023-03-03T07:28:12.442 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 46729 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/phy/realtek.ko 2023-03-03T07:28:12.442 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20617 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/phy/smsc.ko 2023-03-03T07:28:12.442 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10241 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/phy/ste10Xp.ko 2023-03-03T07:28:12.442 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23097 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/phy/vitesse.ko 2023-03-03T07:28:12.442 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/plip/ 2023-03-03T07:28:12.442 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 43697 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/plip/plip.ko 2023-03-03T07:28:12.442 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ppp/ 2023-03-03T07:28:12.443 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15881 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ppp/bsd_comp.ko 2023-03-03T07:28:12.443 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29705 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ppp/ppp_async.ko 2023-03-03T07:28:12.443 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17881 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ppp/ppp_deflate.ko 2023-03-03T07:28:12.443 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18953 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ppp/ppp_mppe.ko 2023-03-03T07:28:12.443 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28809 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ppp/ppp_synctty.ko 2023-03-03T07:28:12.443 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 53641 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ppp/pppoe.ko 2023-03-03T07:28:12.443 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12313 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ppp/pppox.ko 2023-03-03T07:28:12.444 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31281 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ppp/pptp.ko 2023-03-03T07:28:12.444 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28593 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/sb1000.ko 2023-03-03T07:28:12.444 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/slip/ 2023-03-03T07:28:12.444 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 42289 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/slip/slip.ko 2023-03-03T07:28:12.444 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26049 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/sungem_phy.ko 2023-03-03T07:28:12.444 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 62313 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/tap.ko 2023-03-03T07:28:12.444 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/team/ 2023-03-03T07:28:12.444 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 105729 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/team/team.ko 2023-03-03T07:28:12.445 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12913 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/team/team_mode_activebackup.ko 2023-03-03T07:28:12.445 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9721 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/team/team_mode_broadcast.ko 2023-03-03T07:28:12.445 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28553 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-03-03T07:28:12.445 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9145 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/team/team_mode_random.ko 2023-03-03T07:28:12.445 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8825 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-03-03T07:28:12.445 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 82473 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/veth.ko 2023-03-03T07:28:12.445 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/vmxnet3/ 2023-03-03T07:28:12.445 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 121785 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-03-03T07:28:12.446 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/vxlan/ 2023-03-03T07:28:12.446 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 251809 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/vxlan/vxlan.ko 2023-03-03T07:28:12.446 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/xen-netback/ 2023-03-03T07:28:12.446 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 145569 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/xen-netback/xen-netback.ko 2023-03-03T07:28:12.446 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ntb/ 2023-03-03T07:28:12.446 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19105 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ntb/ntb.ko 2023-03-03T07:28:12.446 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/nvme/ 2023-03-03T07:28:12.446 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/nvme/host/ 2023-03-03T07:28:12.447 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 260793 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/nvme/host/nvme-core.ko 2023-03-03T07:28:12.447 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 105977 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/nvme/host/nvme.ko 2023-03-03T07:28:12.447 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/parport/ 2023-03-03T07:28:12.447 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 130233 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/parport/parport.ko 2023-03-03T07:28:12.447 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25617 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/parport/parport_ax88796.ko 2023-03-03T07:28:12.447 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14441 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/parport/parport_cs.ko 2023-03-03T07:28:12.447 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 84817 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/parport/parport_pc.ko 2023-03-03T07:28:12.447 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25953 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/parport/parport_serial.ko 2023-03-03T07:28:12.448 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/pci/ 2023-03-03T07:28:12.448 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/pci/hotplug/ 2023-03-03T07:28:12.448 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24969 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-03-03T07:28:12.448 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17025 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-03-03T07:28:12.448 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20401 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-03-03T07:28:12.448 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11409 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/pci/pci-stub.ko 2023-03-03T07:28:12.448 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 49009 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/pci/xen-pcifront.ko 2023-03-03T07:28:12.449 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/pcmcia/ 2023-03-03T07:28:12.449 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27057 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/pcmcia/i82092.ko 2023-03-03T07:28:12.449 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 146321 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/pcmcia/pcmcia.ko 2023-03-03T07:28:12.449 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 61465 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/pcmcia/pcmcia_core.ko 2023-03-03T07:28:12.449 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34393 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-03-03T07:28:12.449 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34409 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/pcmcia/pd6729.ko 2023-03-03T07:28:12.449 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 107353 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/pcmcia/yenta_socket.ko 2023-03-03T07:28:12.449 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/phy/ 2023-03-03T07:28:12.450 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/phy/broadcom/ 2023-03-03T07:28:12.450 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10353 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-03-03T07:28:12.450 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/phy/samsung/ 2023-03-03T07:28:12.450 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8329 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-03-03T07:28:12.450 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/pinctrl/ 2023-03-03T07:28:12.450 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/pinctrl/intel/ 2023-03-03T07:28:12.450 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 71145 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-03-03T07:28:12.450 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/ 2023-03-03T07:28:12.451 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/chrome/ 2023-03-03T07:28:12.451 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 51761 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-03-03T07:28:12.451 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19297 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/chrome/cros_ec.ko 2023-03-03T07:28:12.451 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21113 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-03-03T07:28:12.451 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24097 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-03-03T07:28:12.451 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26153 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-03-03T07:28:12.451 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18089 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-03-03T07:28:12.452 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17009 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-03-03T07:28:12.452 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/x86/ 2023-03-03T07:28:12.452 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 67201 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/x86/acer-wmi.ko 2023-03-03T07:28:12.452 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 41281 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/x86/acerhdf.ko 2023-03-03T07:28:12.452 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26697 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/x86/apple-gmux.ko 2023-03-03T07:28:12.452 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 61049 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/x86/asus-laptop.ko 2023-03-03T07:28:12.452 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30481 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-03-03T07:28:12.452 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 110601 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/x86/asus-wmi.ko 2023-03-03T07:28:12.453 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 36425 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/x86/classmate-laptop.ko 2023-03-03T07:28:12.453 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 50337 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-03-03T07:28:12.453 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13817 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-03-03T07:28:12.453 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 40241 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-03-03T07:28:12.453 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21729 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-03-03T07:28:12.453 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 36337 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/x86/hdaps.ko 2023-03-03T07:28:12.453 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18961 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/x86/ibm_rtl.ko 2023-03-03T07:28:12.453 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/x86/intel/ 2023-03-03T07:28:12.454 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11585 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-03-03T07:28:12.454 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8761 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-03-03T07:28:12.454 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 43641 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/x86/intel_ips.ko 2023-03-03T07:28:12.454 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20337 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/x86/msi-wmi.ko 2023-03-03T07:28:12.454 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9505 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/x86/mxm-wmi.ko 2023-03-03T07:28:12.454 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 36049 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-03-03T07:28:12.454 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 42593 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/x86/samsung-laptop.ko 2023-03-03T07:28:12.455 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13625 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/x86/samsung-q10.ko 2023-03-03T07:28:12.455 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17401 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/x86/topstar-laptop.ko 2023-03-03T07:28:12.455 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13985 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-03-03T07:28:12.455 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17553 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/x86/toshiba_haps.ko 2023-03-03T07:28:12.455 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10089 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/x86/wmi-bmof.ko 2023-03-03T07:28:12.455 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 55969 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/x86/wmi.ko 2023-03-03T07:28:12.455 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/power/ 2023-03-03T07:28:12.455 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/power/supply/ 2023-03-03T07:28:12.456 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30073 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/power/supply/88pm860x_battery.ko 2023-03-03T07:28:12.456 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34041 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/power/supply/88pm860x_charger.ko 2023-03-03T07:28:12.456 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 54593 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/power/supply/bq2415x_charger.ko 2023-03-03T07:28:12.456 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 55041 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/power/supply/bq24190_charger.ko 2023-03-03T07:28:12.456 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22089 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/power/supply/bq24735-charger.ko 2023-03-03T07:28:12.456 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16681 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-03-03T07:28:12.456 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19105 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/power/supply/da9030_battery.ko 2023-03-03T07:28:12.456 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19769 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/power/supply/da9052-battery.ko 2023-03-03T07:28:12.457 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29537 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/power/supply/ds2760_battery.ko 2023-03-03T07:28:12.457 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23873 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/power/supply/ds2780_battery.ko 2023-03-03T07:28:12.457 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24009 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/power/supply/ds2781_battery.ko 2023-03-03T07:28:12.457 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23665 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/power/supply/ds2782_battery.ko 2023-03-03T07:28:12.457 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20601 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/power/supply/gpio-charger.ko 2023-03-03T07:28:12.457 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18081 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/power/supply/isp1704_charger.ko 2023-03-03T07:28:12.457 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20369 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/power/supply/lp8727_charger.ko 2023-03-03T07:28:12.457 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12417 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/power/supply/max14577_charger.ko 2023-03-03T07:28:12.458 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26137 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/power/supply/max17040_battery.ko 2023-03-03T07:28:12.458 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30681 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/power/supply/max17042_battery.ko 2023-03-03T07:28:12.458 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18625 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/power/supply/max8903_charger.ko 2023-03-03T07:28:12.458 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24193 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/power/supply/max8925_power.ko 2023-03-03T07:28:12.458 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21209 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/power/supply/pcf50633-charger.ko 2023-03-03T07:28:12.458 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28761 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/power/supply/pda_power.ko 2023-03-03T07:28:12.458 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 38729 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/power/supply/sbs-battery.ko 2023-03-03T07:28:12.459 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28193 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/power/supply/test_power.ko 2023-03-03T07:28:12.459 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19497 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/power/supply/tps65090-charger.ko 2023-03-03T07:28:12.459 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12025 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/power/supply/wm831x_backup.ko 2023-03-03T07:28:12.459 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24777 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/power/supply/wm831x_power.ko 2023-03-03T07:28:12.459 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22209 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/power/supply/wm8350_power.ko 2023-03-03T07:28:12.459 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/powercap/ 2023-03-03T07:28:12.459 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 54241 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/powercap/intel_rapl_common.ko 2023-03-03T07:28:12.459 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17225 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/powercap/intel_rapl_msr.ko 2023-03-03T07:28:12.460 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/pps/ 2023-03-03T07:28:12.460 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/pps/clients/ 2023-03-03T07:28:12.460 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15529 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/pps/clients/pps-gpio.ko 2023-03-03T07:28:12.460 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13137 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/pps/clients/pps-ldisc.ko 2023-03-03T07:28:12.460 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16121 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/pps/clients/pps_parport.ko 2023-03-03T07:28:12.460 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 41393 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/pps/pps_core.ko 2023-03-03T07:28:12.460 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ptp/ 2023-03-03T07:28:12.460 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 64521 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ptp/ptp.ko 2023-03-03T07:28:12.461 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15921 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ptp/ptp_kvm.ko 2023-03-03T07:28:12.461 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/ 2023-03-03T07:28:12.461 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23201 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-88pm80x.ko 2023-03-03T07:28:12.461 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24449 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-88pm860x.ko 2023-03-03T07:28:12.461 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15505 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-bq32k.ko 2023-03-03T07:28:12.461 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12465 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-bq4802.ko 2023-03-03T07:28:12.461 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21521 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-da9052.ko 2023-03-03T07:28:12.461 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19529 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-da9055.ko 2023-03-03T07:28:12.462 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20969 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-da9063.ko 2023-03-03T07:28:12.462 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16017 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-ds1286.ko 2023-03-03T07:28:12.462 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 69769 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-ds1307.ko 2023-03-03T07:28:12.462 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20785 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-ds1374.ko 2023-03-03T07:28:12.462 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18081 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-ds1511.ko 2023-03-03T07:28:12.462 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16665 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-ds1553.ko 2023-03-03T07:28:12.462 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14049 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-ds1672.ko 2023-03-03T07:28:12.463 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13249 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-ds1742.ko 2023-03-03T07:28:12.463 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17193 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-ds2404.ko 2023-03-03T07:28:12.463 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23977 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-ds3232.ko 2023-03-03T07:28:12.463 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11081 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-em3027.ko 2023-03-03T07:28:12.463 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24553 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-fm3130.ko 2023-03-03T07:28:12.463 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17273 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-isl12022.ko 2023-03-03T07:28:12.463 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 36649 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-isl1208.ko 2023-03-03T07:28:12.463 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14881 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-lp8788.ko 2023-03-03T07:28:12.464 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 38609 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-m41t80.ko 2023-03-03T07:28:12.464 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11601 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-m48t35.ko 2023-03-03T07:28:12.464 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25761 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-m48t59.ko 2023-03-03T07:28:12.464 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14105 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-m48t86.ko 2023-03-03T07:28:12.464 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11649 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-max6900.ko 2023-03-03T07:28:12.464 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14393 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-max8907.ko 2023-03-03T07:28:12.464 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15129 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-max8925.ko 2023-03-03T07:28:12.464 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27473 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-max8997.ko 2023-03-03T07:28:12.465 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16505 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-max8998.ko 2023-03-03T07:28:12.465 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18001 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-03-03T07:28:12.465 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10833 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-msm6242.ko 2023-03-03T07:28:12.465 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20297 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-palmas.ko 2023-03-03T07:28:12.465 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 41345 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-pcf2127.ko 2023-03-03T07:28:12.465 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17993 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-pcf50633.ko 2023-03-03T07:28:12.465 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26769 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-pcf85063.ko 2023-03-03T07:28:12.465 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21473 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-pcf8523.ko 2023-03-03T07:28:12.466 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31169 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-pcf8563.ko 2023-03-03T07:28:12.466 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12409 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-pcf8583.ko 2023-03-03T07:28:12.466 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18225 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-rc5t583.ko 2023-03-03T07:28:12.466 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12377 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-rp5c01.ko 2023-03-03T07:28:12.466 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34289 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-rs5c372.ko 2023-03-03T07:28:12.466 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28225 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-03-03T07:28:12.466 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25945 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-rx8025.ko 2023-03-03T07:28:12.466 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19993 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-rx8581.ko 2023-03-03T07:28:12.467 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21721 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-s35390a.ko 2023-03-03T07:28:12.467 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16761 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-03-03T07:28:12.467 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18273 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-tps6586x.ko 2023-03-03T07:28:12.467 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22441 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-tps65910.ko 2023-03-03T07:28:12.467 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24273 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-v3020.ko 2023-03-03T07:28:12.467 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21441 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-wm831x.ko 2023-03-03T07:28:12.467 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22041 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-wm8350.ko 2023-03-03T07:28:12.468 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29033 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-x1205.ko 2023-03-03T07:28:12.468 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/ 2023-03-03T07:28:12.468 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 80473 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/3w-9xxx.ko 2023-03-03T07:28:12.468 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 59537 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/3w-sas.ko 2023-03-03T07:28:12.468 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 58937 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/3w-xxxx.ko 2023-03-03T07:28:12.468 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 130513 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/BusLogic.ko 2023-03-03T07:28:12.468 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27057 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/a100u2w.ko 2023-03-03T07:28:12.468 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/aacraid/ 2023-03-03T07:28:12.469 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 278169 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/aacraid/aacraid.ko 2023-03-03T07:28:12.469 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 102809 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/advansys.ko 2023-03-03T07:28:12.469 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/aic7xxx/ 2023-03-03T07:28:12.469 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 364593 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-03-03T07:28:12.469 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 304337 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-03-03T07:28:12.469 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/aic94xx/ 2023-03-03T07:28:12.469 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 193489 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-03-03T07:28:12.469 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24777 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/am53c974.ko 2023-03-03T07:28:12.470 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/arcmsr/ 2023-03-03T07:28:12.470 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 110193 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-03-03T07:28:12.470 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 39001 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/atp870u.ko 2023-03-03T07:28:12.470 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/be2iscsi/ 2023-03-03T07:28:12.470 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 263329 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-03-03T07:28:12.470 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/bfa/ 2023-03-03T07:28:12.470 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 1178769 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/bfa/bfa.ko 2023-03-03T07:28:12.470 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/bnx2fc/ 2023-03-03T07:28:12.471 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 251577 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-03-03T07:28:12.471 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/bnx2i/ 2023-03-03T07:28:12.471 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 121057 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-03-03T07:28:12.471 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 40393 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/ch.ko 2023-03-03T07:28:12.471 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/csiostor/ 2023-03-03T07:28:12.471 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 321433 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/csiostor/csiostor.ko 2023-03-03T07:28:12.471 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/cxgbi/ 2023-03-03T07:28:12.471 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-03-03T07:28:12.472 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 80577 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-03-03T07:28:12.472 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-03-03T07:28:12.472 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 108769 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-03-03T07:28:12.472 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 153305 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-03-03T07:28:12.472 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 78601 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/dc395x.ko 2023-03-03T07:28:12.472 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 38769 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/dmx3191d.ko 2023-03-03T07:28:12.472 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/esas2r/ 2023-03-03T07:28:12.473 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 212161 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/esas2r/esas2r.ko 2023-03-03T07:28:12.473 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 63337 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/esp_scsi.ko 2023-03-03T07:28:12.473 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/fcoe/ 2023-03-03T07:28:12.473 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 80761 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/fcoe/fcoe.ko 2023-03-03T07:28:12.473 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 164201 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-03-03T07:28:12.473 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18481 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/fdomain.ko 2023-03-03T07:28:12.473 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/fnic/ 2023-03-03T07:28:12.473 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 274297 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/fnic/fnic.ko 2023-03-03T07:28:12.474 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 208345 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/hpsa.ko 2023-03-03T07:28:12.474 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 51217 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/hptiop.ko 2023-03-03T07:28:12.474 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 50281 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/hv_storvsc.ko 2023-03-03T07:28:12.474 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 36745 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/imm.ko 2023-03-03T07:28:12.474 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 45985 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/initio.ko 2023-03-03T07:28:12.474 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 302617 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/ipr.ko 2023-03-03T07:28:12.474 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 106865 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/ips.ko 2023-03-03T07:28:12.474 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/isci/ 2023-03-03T07:28:12.475 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 328585 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/isci/isci.ko 2023-03-03T07:28:12.475 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25025 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-03-03T07:28:12.475 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 53017 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/iscsi_tcp.ko 2023-03-03T07:28:12.475 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/libfc/ 2023-03-03T07:28:12.475 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 325545 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/libfc/libfc.ko 2023-03-03T07:28:12.475 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 147233 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/libiscsi.ko 2023-03-03T07:28:12.475 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 55033 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/libiscsi_tcp.ko 2023-03-03T07:28:12.475 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/libsas/ 2023-03-03T07:28:12.476 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 217481 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/libsas/libsas.ko 2023-03-03T07:28:12.476 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/lpfc/ 2023-03-03T07:28:12.476 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 2313865 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/lpfc/lpfc.ko 2023-03-03T07:28:12.476 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/megaraid/ 2023-03-03T07:28:12.476 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 80145 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-03-03T07:28:12.476 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33609 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-03-03T07:28:12.476 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 324825 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-03-03T07:28:12.477 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 86001 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/megaraid.ko 2023-03-03T07:28:12.477 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/mpt3sas/ 2023-03-03T07:28:12.477 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 699913 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-03-03T07:28:12.477 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/mvsas/ 2023-03-03T07:28:12.477 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 121249 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/mvsas/mvsas.ko 2023-03-03T07:28:12.477 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 82153 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/mvumi.ko 2023-03-03T07:28:12.477 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/pcmcia/ 2023-03-03T07:28:12.477 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 82769 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-03-03T07:28:12.478 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11569 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-03-03T07:28:12.478 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20745 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-03-03T07:28:12.478 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24185 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-03-03T07:28:12.478 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/pm8001/ 2023-03-03T07:28:12.478 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 405633 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-03-03T07:28:12.478 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 131457 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/pmcraid.ko 2023-03-03T07:28:12.478 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34057 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/ppa.ko 2023-03-03T07:28:12.478 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 57137 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/qla1280.ko 2023-03-03T07:28:12.479 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/qla2xxx/ 2023-03-03T07:28:12.479 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 1854193 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-03-03T07:28:12.479 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 89473 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-03-03T07:28:12.479 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/qla4xxx/ 2023-03-03T07:28:12.479 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 596697 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-03-03T07:28:12.479 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17937 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/qlogicfas408.ko 2023-03-03T07:28:12.479 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18137 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/raid_class.ko 2023-03-03T07:28:12.479 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 246129 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/scsi_debug.ko 2023-03-03T07:28:12.480 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 173377 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/scsi_transport_fc.ko 2023-03-03T07:28:12.480 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 276017 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-03-03T07:28:12.480 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 94793 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/scsi_transport_sas.ko 2023-03-03T07:28:12.480 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 73665 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/scsi_transport_spi.ko 2023-03-03T07:28:12.480 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 43465 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/scsi_transport_srp.ko 2023-03-03T07:28:12.480 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25705 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/ses.ko 2023-03-03T07:28:12.480 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 116161 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/st.ko 2023-03-03T07:28:12.481 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 48193 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/stex.ko 2023-03-03T07:28:12.481 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/sym53c8xx_2/ 2023-03-03T07:28:12.481 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 167465 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-03-03T07:28:12.481 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 42177 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/virtio_scsi.ko 2023-03-03T07:28:12.481 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 50569 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/vmw_pvscsi.ko 2023-03-03T07:28:12.481 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 41689 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/wd719x.ko 2023-03-03T07:28:12.481 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 51225 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/xen-scsifront.ko 2023-03-03T07:28:12.481 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ssb/ 2023-03-03T07:28:12.482 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 130601 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ssb/ssb.ko 2023-03-03T07:28:12.482 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/target/ 2023-03-03T07:28:12.482 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/target/iscsi/ 2023-03-03T07:28:12.482 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 761009 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-03-03T07:28:12.482 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/target/loopback/ 2023-03-03T07:28:12.482 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 52121 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/target/loopback/tcm_loop.ko 2023-03-03T07:28:12.482 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 41241 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/target/target_core_file.ko 2023-03-03T07:28:12.482 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 39753 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/target/target_core_iblock.ko 2023-03-03T07:28:12.483 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 937993 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/target/target_core_mod.ko 2023-03-03T07:28:12.483 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 45993 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/target/target_core_pscsi.ko 2023-03-03T07:28:12.483 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 124425 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/target/target_core_user.ko 2023-03-03T07:28:12.483 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/target/tcm_fc/ 2023-03-03T07:28:12.483 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 77081 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-03-03T07:28:12.483 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/thermal/ 2023-03-03T07:28:12.483 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/thermal/intel/ 2023-03-03T07:28:12.483 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/thermal/intel/int340x_thermal/ 2023-03-03T07:28:12.484 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19617 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-03-03T07:28:12.484 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27569 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-03-03T07:28:12.484 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9521 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-03-03T07:28:12.484 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9761 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-03-03T07:28:12.484 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14985 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-03-03T07:28:12.484 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18369 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-03-03T07:28:12.484 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27521 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-03-03T07:28:12.485 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21001 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-03-03T07:28:12.485 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14825 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-03-03T07:28:12.485 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13305 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-03-03T07:28:12.485 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12097 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-03-03T07:28:12.485 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27369 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-03-03T07:28:12.485 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21609 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/thermal/intel/intel_menlow.ko 2023-03-03T07:28:12.485 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31521 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-03-03T07:28:12.485 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20425 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-03-03T07:28:12.486 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11337 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-03-03T07:28:12.486 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26265 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-03-03T07:28:12.486 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/tty/ 2023-03-03T07:28:12.486 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/tty/ipwireless/ 2023-03-03T07:28:12.486 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 80145 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-03-03T07:28:12.486 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 58433 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/tty/moxa.ko 2023-03-03T07:28:12.486 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 50561 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/tty/mxser.ko 2023-03-03T07:28:12.487 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 103217 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/tty/n_gsm.ko 2023-03-03T07:28:12.487 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31833 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/tty/n_hdlc.ko 2023-03-03T07:28:12.487 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 68865 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/tty/nozomi.ko 2023-03-03T07:28:12.487 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/tty/serial/ 2023-03-03T07:28:12.487 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/tty/serial/8250/ 2023-03-03T07:28:12.487 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 35105 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-03-03T07:28:12.487 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 59457 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-03-03T07:28:12.487 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17921 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-03-03T07:28:12.488 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22161 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/tty/serial/altera_uart.ko 2023-03-03T07:28:12.488 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9401 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/tty/serial/arc_uart.ko 2023-03-03T07:28:12.488 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 69097 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-03-03T07:28:12.488 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/tty/serial/jsm/ 2023-03-03T07:28:12.488 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 102929 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/tty/serial/jsm/jsm.ko 2023-03-03T07:28:12.488 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28785 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/tty/serial/rp2.ko 2023-03-03T07:28:12.488 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 51993 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/tty/serial/sc16is7xx.ko 2023-03-03T07:28:12.488 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 106785 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/tty/synclink_gt.ko 2023-03-03T07:28:12.489 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ufs/ 2023-03-03T07:28:12.489 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ufs/core/ 2023-03-03T07:28:12.489 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 507913 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ufs/core/ufshcd-core.ko 2023-03-03T07:28:12.489 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ufs/host/ 2023-03-03T07:28:12.489 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28705 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-03-03T07:28:12.489 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13993 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-03-03T07:28:12.489 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/uio/ 2023-03-03T07:28:12.489 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 43377 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/uio/uio.ko 2023-03-03T07:28:12.490 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12113 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/uio/uio_aec.ko 2023-03-03T07:28:12.490 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10785 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/uio/uio_cif.ko 2023-03-03T07:28:12.490 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18737 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/uio/uio_dmem_genirq.ko 2023-03-03T07:28:12.490 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12505 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/uio/uio_mf624.ko 2023-03-03T07:28:12.490 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12057 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/uio/uio_netx.ko 2023-03-03T07:28:12.490 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10569 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/uio/uio_pci_generic.ko 2023-03-03T07:28:12.490 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16377 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-03-03T07:28:12.491 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13209 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/uio/uio_sercos3.ko 2023-03-03T07:28:12.491 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/ 2023-03-03T07:28:12.491 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/c67x00/ 2023-03-03T07:28:12.491 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 73801 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/c67x00/c67x00.ko 2023-03-03T07:28:12.491 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/chipidea/ 2023-03-03T07:28:12.491 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 148737 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-03-03T07:28:12.491 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18385 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-03-03T07:28:12.491 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12689 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-03-03T07:28:12.492 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12601 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-03-03T07:28:12.492 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/class/ 2023-03-03T07:28:12.492 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 86289 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/class/cdc-acm.ko 2023-03-03T07:28:12.492 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 52641 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/class/cdc-wdm.ko 2023-03-03T07:28:12.492 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 48329 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/class/usblp.ko 2023-03-03T07:28:12.492 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 93297 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/class/usbtmc.ko 2023-03-03T07:28:12.492 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/common/ 2023-03-03T07:28:12.492 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22001 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/common/ulpi.ko 2023-03-03T07:28:12.493 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/dwc2/ 2023-03-03T07:28:12.493 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11833 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-03-03T07:28:12.493 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/dwc3/ 2023-03-03T07:28:12.493 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12065 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-03-03T07:28:12.493 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29737 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-03-03T07:28:12.493 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 308233 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/dwc3/dwc3.ko 2023-03-03T07:28:12.493 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/gadget/ 2023-03-03T07:28:12.494 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/gadget/function/ 2023-03-03T07:28:12.494 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 46793 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/gadget/function/u_ether.ko 2023-03-03T07:28:12.494 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 49809 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/gadget/function/u_serial.ko 2023-03-03T07:28:12.494 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29001 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-03-03T07:28:12.494 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 40633 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-03-03T07:28:12.494 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27801 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-03-03T07:28:12.494 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 36289 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-03-03T07:28:12.494 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 92065 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-03-03T07:28:12.495 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 52241 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-03-03T07:28:12.495 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 121233 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-03-03T07:28:12.495 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 58593 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-03-03T07:28:12.495 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22505 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-03-03T07:28:12.495 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31113 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-03-03T07:28:12.495 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 58313 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-03-03T07:28:12.495 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 85033 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-03-03T07:28:12.495 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19281 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-03-03T07:28:12.496 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 58801 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-03-03T07:28:12.496 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 72505 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-03-03T07:28:12.496 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/gadget/legacy/ 2023-03-03T07:28:12.496 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20761 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-03-03T07:28:12.496 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17713 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-03-03T07:28:12.496 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17977 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-03-03T07:28:12.496 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21513 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-03-03T07:28:12.496 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28081 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-03-03T07:28:12.497 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18609 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-03-03T07:28:12.497 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19937 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-03-03T07:28:12.497 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16737 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-03-03T07:28:12.497 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31505 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-03-03T07:28:12.497 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16289 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-03-03T07:28:12.497 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18761 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-03-03T07:28:12.497 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26625 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-03-03T07:28:12.498 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 62145 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-03-03T07:28:12.498 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14713 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-03-03T07:28:12.498 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 144601 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/gadget/libcomposite.ko 2023-03-03T07:28:12.498 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/gadget/udc/ 2023-03-03T07:28:12.498 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16945 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-03-03T07:28:12.498 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/gadget/udc/bdc/ 2023-03-03T07:28:12.498 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 158873 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-03-03T07:28:12.498 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 36505 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-03-03T07:28:12.499 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 55745 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-03-03T07:28:12.499 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 70993 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-03-03T07:28:12.499 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 57921 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-03-03T07:28:12.499 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 75705 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/gadget/udc/net2272.ko 2023-03-03T07:28:12.499 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 77905 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/gadget/udc/net2280.ko 2023-03-03T07:28:12.499 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 74081 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-03-03T07:28:12.499 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 66697 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-03-03T07:28:12.499 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 70145 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-03-03T07:28:12.500 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 80881 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-03-03T07:28:12.500 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 149737 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-03-03T07:28:12.500 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/host/ 2023-03-03T07:28:12.500 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11153 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/host/bcma-hcd.ko 2023-03-03T07:28:12.500 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 80897 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/host/isp116x-hcd.ko 2023-03-03T07:28:12.500 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 88897 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-03-03T07:28:12.500 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 81417 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-03-03T07:28:12.500 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 51089 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/host/sl811-hcd.ko 2023-03-03T07:28:12.501 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15617 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/host/sl811_cs.ko 2023-03-03T07:28:12.501 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12817 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/host/ssb-hcd.ko 2023-03-03T07:28:12.501 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 98497 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/host/u132-hcd.ko 2023-03-03T07:28:12.501 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21761 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-03-03T07:28:12.501 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/image/ 2023-03-03T07:28:12.501 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 35457 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/image/mdc800.ko 2023-03-03T07:28:12.501 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22625 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/image/microtek.ko 2023-03-03T07:28:12.502 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/misc/ 2023-03-03T07:28:12.502 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 42209 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/misc/adutux.ko 2023-03-03T07:28:12.502 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21177 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/misc/appledisplay.ko 2023-03-03T07:28:12.502 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17225 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-03-03T07:28:12.502 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22545 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/misc/cytherm.ko 2023-03-03T07:28:12.502 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13905 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/misc/ehset.ko 2023-03-03T07:28:12.502 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13857 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/misc/emi26.ko 2023-03-03T07:28:12.502 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15441 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/misc/emi62.ko 2023-03-03T07:28:12.503 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11057 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/misc/ezusb.ko 2023-03-03T07:28:12.503 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 78945 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/misc/ftdi-elan.ko 2023-03-03T07:28:12.503 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19497 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/misc/idmouse.ko 2023-03-03T07:28:12.503 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 37273 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/misc/iowarrior.ko 2023-03-03T07:28:12.503 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11673 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/misc/isight_firmware.ko 2023-03-03T07:28:12.503 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 37337 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/misc/ldusb.ko 2023-03-03T07:28:12.503 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 36825 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/misc/legousbtower.ko 2023-03-03T07:28:12.503 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28041 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/misc/lvstest.ko 2023-03-03T07:28:12.504 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/misc/sisusbvga/ 2023-03-03T07:28:12.504 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 64617 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-03-03T07:28:12.504 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12505 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/misc/trancevibrator.ko 2023-03-03T07:28:12.504 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20921 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/misc/usb3503.ko 2023-03-03T07:28:12.504 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25401 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/misc/usblcd.ko 2023-03-03T07:28:12.504 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22249 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/misc/usbsevseg.ko 2023-03-03T07:28:12.504 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 70937 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/misc/usbtest.ko 2023-03-03T07:28:12.504 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 43401 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/misc/uss720.ko 2023-03-03T07:28:12.505 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28585 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/misc/yurex.ko 2023-03-03T07:28:12.505 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/mon/ 2023-03-03T07:28:12.505 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 71345 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/mon/usbmon.ko 2023-03-03T07:28:12.505 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/musb/ 2023-03-03T07:28:12.505 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 303201 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/musb/musb_hdrc.ko 2023-03-03T07:28:12.505 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/phy/ 2023-03-03T07:28:12.505 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19985 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/phy/phy-generic.ko 2023-03-03T07:28:12.505 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19785 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-03-03T07:28:12.506 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11529 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/phy/phy-isp1301.ko 2023-03-03T07:28:12.506 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22401 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/phy/phy-tahvo.ko 2023-03-03T07:28:12.506 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/ 2023-03-03T07:28:12.506 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12753 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/aircable.ko 2023-03-03T07:28:12.506 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33633 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/ark3116.ko 2023-03-03T07:28:12.506 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26745 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/belkin_sa.ko 2023-03-03T07:28:12.506 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 38545 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/ch341.ko 2023-03-03T07:28:12.506 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 70913 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/cp210x.ko 2023-03-03T07:28:12.507 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31857 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/cyberjack.ko 2023-03-03T07:28:12.507 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 59153 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/cypress_m8.ko 2023-03-03T07:28:12.507 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 50753 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/digi_acceleport.ko 2023-03-03T07:28:12.507 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9409 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/empeg.ko 2023-03-03T07:28:12.507 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 46161 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/f81232.ko 2023-03-03T07:28:12.507 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 176201 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/ftdi_sio.ko 2023-03-03T07:28:12.507 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 53369 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/garmin_gps.ko 2023-03-03T07:28:12.507 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 138737 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/io_edgeport.ko 2023-03-03T07:28:12.544 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 127865 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/io_ti.ko 2023-03-03T07:28:12.544 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 67625 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/ipaq.ko 2023-03-03T07:28:12.544 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19153 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/ipw.ko 2023-03-03T07:28:12.545 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27129 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/ir-usb.ko 2023-03-03T07:28:12.545 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 58049 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-03-03T07:28:12.545 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 109001 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/keyspan.ko 2023-03-03T07:28:12.545 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 35289 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/keyspan_pda.ko 2023-03-03T07:28:12.545 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25937 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/kl5kusb105.ko 2023-03-03T07:28:12.545 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33297 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/kobil_sct.ko 2023-03-03T07:28:12.545 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33105 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/mct_u232.ko 2023-03-03T07:28:12.546 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21905 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/metro-usb.ko 2023-03-03T07:28:12.546 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 66961 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/mos7720.ko 2023-03-03T07:28:12.546 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 78345 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/mos7840.ko 2023-03-03T07:28:12.546 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 58217 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/mxuport.ko 2023-03-03T07:28:12.546 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13681 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/navman.ko 2023-03-03T07:28:12.546 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11121 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/omninet.ko 2023-03-03T07:28:12.546 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24097 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/opticon.ko 2023-03-03T07:28:12.547 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 186489 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/option.ko 2023-03-03T07:28:12.547 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 40041 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/oti6858.ko 2023-03-03T07:28:12.547 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 54681 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/pl2303.ko 2023-03-03T07:28:12.547 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9305 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/qcaux.ko 2023-03-03T07:28:12.547 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 37913 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/qcserial.ko 2023-03-03T07:28:12.547 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 35225 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/quatech2.ko 2023-03-03T07:28:12.547 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14569 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/safe_serial.ko 2023-03-03T07:28:12.547 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 51945 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/sierra.ko 2023-03-03T07:28:12.548 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21921 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/spcp8x5.ko 2023-03-03T07:28:12.548 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29729 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/ssu100.ko 2023-03-03T07:28:12.548 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16985 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/symbolserial.ko 2023-03-03T07:28:12.548 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 63465 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-03-03T07:28:12.548 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22241 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-03-03T07:28:12.548 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9817 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/usb_debug.ko 2023-03-03T07:28:12.548 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 32185 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/usb_wwan.ko 2023-03-03T07:28:12.548 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 123553 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/usbserial.ko 2023-03-03T07:28:12.549 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29369 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/visor.ko 2023-03-03T07:28:12.549 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 37793 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/whiteheat.ko 2023-03-03T07:28:12.549 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10201 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/wishbone-serial.ko 2023-03-03T07:28:12.549 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8793 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/xsens_mt.ko 2023-03-03T07:28:12.549 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/storage/ 2023-03-03T07:28:12.549 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 52897 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/storage/uas.ko 2023-03-03T07:28:12.549 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26257 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/storage/ums-alauda.ko 2023-03-03T07:28:12.550 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12553 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/storage/ums-cypress.ko 2023-03-03T07:28:12.550 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21561 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/storage/ums-datafab.ko 2023-03-03T07:28:12.550 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 32841 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-03-03T07:28:12.550 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13417 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/storage/ums-freecom.ko 2023-03-03T07:28:12.550 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19345 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/storage/ums-isd200.ko 2023-03-03T07:28:12.550 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18873 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-03-03T07:28:12.550 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13217 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/storage/ums-karma.ko 2023-03-03T07:28:12.550 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17817 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/storage/ums-onetouch.ko 2023-03-03T07:28:12.551 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28001 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/storage/ums-realtek.ko 2023-03-03T07:28:12.551 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29393 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/storage/ums-sddr09.ko 2023-03-03T07:28:12.551 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19449 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/storage/ums-sddr55.ko 2023-03-03T07:28:12.551 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34913 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/storage/ums-usbat.ko 2023-03-03T07:28:12.551 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 177089 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/storage/usb-storage.ko 2023-03-03T07:28:12.551 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/usbip/ 2023-03-03T07:28:12.551 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 66673 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/usbip/usbip-core.ko 2023-03-03T07:28:12.551 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 73201 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/usbip/usbip-host.ko 2023-03-03T07:28:12.552 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 108825 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-03-03T07:28:12.552 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/vfio/ 2023-03-03T07:28:12.552 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/vfio/pci/ 2023-03-03T07:28:12.552 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 147089 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-03-03T07:28:12.552 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29401 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/vfio/pci/vfio-pci.ko 2023-03-03T07:28:12.552 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 94817 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/vfio/vfio.ko 2023-03-03T07:28:12.552 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 72001 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-03-03T07:28:12.553 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/vhost/ 2023-03-03T07:28:12.553 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 98497 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/vhost/vhost.ko 2023-03-03T07:28:12.553 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15369 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/vhost/vhost_iotlb.ko 2023-03-03T07:28:12.553 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 57905 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/vhost/vhost_net.ko 2023-03-03T07:28:12.553 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 91265 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/vhost/vhost_scsi.ko 2023-03-03T07:28:12.553 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/video/ 2023-03-03T07:28:12.553 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/video/backlight/ 2023-03-03T07:28:12.553 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15449 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-03-03T07:28:12.554 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12769 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/video/backlight/aat2870_bl.ko 2023-03-03T07:28:12.554 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23297 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/video/backlight/adp5520_bl.ko 2023-03-03T07:28:12.554 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33097 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/video/backlight/adp8860_bl.ko 2023-03-03T07:28:12.554 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 43433 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/video/backlight/adp8870_bl.ko 2023-03-03T07:28:12.554 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18145 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/video/backlight/apple_bl.ko 2023-03-03T07:28:12.554 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16721 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/video/backlight/as3711_bl.ko 2023-03-03T07:28:12.554 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12049 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/video/backlight/bd6107.ko 2023-03-03T07:28:12.555 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11345 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/video/backlight/da903x_bl.ko 2023-03-03T07:28:12.555 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11097 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/video/backlight/da9052_bl.ko 2023-03-03T07:28:12.555 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11841 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/video/backlight/gpio_backlight.ko 2023-03-03T07:28:12.555 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14337 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/video/backlight/kb3886_bl.ko 2023-03-03T07:28:12.555 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21041 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/video/backlight/lcd.ko 2023-03-03T07:28:12.555 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23617 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/video/backlight/lm3533_bl.ko 2023-03-03T07:28:12.555 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20737 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/video/backlight/lm3639_bl.ko 2023-03-03T07:28:12.555 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11465 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/video/backlight/lv5207lp.ko 2023-03-03T07:28:12.556 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14265 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/video/backlight/max8925_bl.ko 2023-03-03T07:28:12.556 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11257 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/video/backlight/pandora_bl.ko 2023-03-03T07:28:12.556 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10361 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-03-03T07:28:12.556 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10833 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/video/backlight/platform_lcd.ko 2023-03-03T07:28:12.556 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12825 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/video/backlight/wm831x_bl.ko 2023-03-03T07:28:12.556 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/w1/ 2023-03-03T07:28:12.556 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/w1/masters/ 2023-03-03T07:28:12.556 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 36929 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/w1/masters/ds1wm.ko 2023-03-03T07:28:12.557 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18417 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/w1/masters/ds2482.ko 2023-03-03T07:28:12.557 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 39569 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/w1/masters/ds2490.ko 2023-03-03T07:28:12.557 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11281 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/w1/masters/matrox_w1.ko 2023-03-03T07:28:12.557 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12305 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/w1/masters/w1-gpio.ko 2023-03-03T07:28:12.557 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/w1/slaves/ 2023-03-03T07:28:12.557 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11609 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-03-03T07:28:12.557 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22305 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-03-03T07:28:12.558 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15193 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-03-03T07:28:12.558 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10705 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-03-03T07:28:12.558 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14161 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-03-03T07:28:12.558 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11433 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-03-03T07:28:12.558 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13241 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-03-03T07:28:12.558 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13241 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-03-03T07:28:12.558 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17841 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-03-03T07:28:12.558 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 6865 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/w1/slaves/w1_smem.ko 2023-03-03T07:28:12.559 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 60257 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/w1/slaves/w1_therm.ko 2023-03-03T07:28:12.559 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 102657 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/w1/wire.ko 2023-03-03T07:28:12.559 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/ 2023-03-03T07:28:12.559 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18465 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/acquirewdt.ko 2023-03-03T07:28:12.559 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19585 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/advantechwdt.ko 2023-03-03T07:28:12.559 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18313 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/alim1535_wdt.ko 2023-03-03T07:28:12.559 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22849 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/alim7101_wdt.ko 2023-03-03T07:28:12.559 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19201 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/cpu5wdt.ko 2023-03-03T07:28:12.560 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13233 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/da9052_wdt.ko 2023-03-03T07:28:12.560 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12153 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/da9055_wdt.ko 2023-03-03T07:28:12.560 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17113 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/da9063_wdt.ko 2023-03-03T07:28:12.560 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20801 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/dw_wdt.ko 2023-03-03T07:28:12.560 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19977 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/eurotechwdt.ko 2023-03-03T07:28:12.560 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23729 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/f71808e_wdt.ko 2023-03-03T07:28:12.560 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27289 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/hpwdt.ko 2023-03-03T07:28:12.560 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15553 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/i6300esb.ko 2023-03-03T07:28:12.561 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9777 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-03-03T07:28:12.561 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22097 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/iTCO_wdt.ko 2023-03-03T07:28:12.561 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18993 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/ib700wdt.ko 2023-03-03T07:28:12.561 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18265 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/ibmasr.ko 2023-03-03T07:28:12.561 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19641 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-03-03T07:28:12.561 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20841 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/it8712f_wdt.ko 2023-03-03T07:28:12.561 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13377 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/it87_wdt.ko 2023-03-03T07:28:12.562 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21353 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/kempld_wdt.ko 2023-03-03T07:28:12.562 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18305 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/machzwd.ko 2023-03-03T07:28:12.562 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14881 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/mena21_wdt.ko 2023-03-03T07:28:12.562 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12777 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-03-03T07:28:12.562 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25049 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/nv_tco.ko 2023-03-03T07:28:12.562 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18169 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-03-03T07:28:12.562 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21753 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/pc87413_wdt.ko 2023-03-03T07:28:12.562 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 38937 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/pcwd_pci.ko 2023-03-03T07:28:12.563 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33105 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/pcwd_usb.ko 2023-03-03T07:28:12.563 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12545 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/retu_wdt.ko 2023-03-03T07:28:12.563 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20145 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-03-03T07:28:12.563 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13561 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-03-03T07:28:12.563 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16985 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-03-03T07:28:12.563 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23473 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/sc1200wdt.ko 2023-03-03T07:28:12.563 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23369 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/sch311x_wdt.ko 2023-03-03T07:28:12.563 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21121 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-03-03T07:28:12.564 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16921 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/softdog.ko 2023-03-03T07:28:12.564 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22201 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/sp5100_tco.ko 2023-03-03T07:28:12.564 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12321 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/twl4030_wdt.ko 2023-03-03T07:28:12.564 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17665 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/via_wdt.ko 2023-03-03T07:28:12.564 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18393 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-03-03T07:28:12.564 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20449 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/w83877f_wdt.ko 2023-03-03T07:28:12.564 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24753 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/w83977f_wdt.ko 2023-03-03T07:28:12.564 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18209 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/wafer5823wdt.ko 2023-03-03T07:28:12.565 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28769 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/wdt_pci.ko 2023-03-03T07:28:12.565 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16089 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/wm831x_wdt.ko 2023-03-03T07:28:12.565 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13873 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/wm8350_wdt.ko 2023-03-03T07:28:12.565 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15537 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/xen_wdt.ko 2023-03-03T07:28:12.565 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/xen/ 2023-03-03T07:28:12.565 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23921 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/xen/xen-evtchn.ko 2023-03-03T07:28:12.565 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25417 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/xen/xen-gntalloc.ko 2023-03-03T07:28:12.566 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 46361 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/xen/xen-gntdev.ko 2023-03-03T07:28:12.566 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/xen/xen-pciback/ 2023-03-03T07:28:12.566 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 179209 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-03-03T07:28:12.566 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 38081 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/xen/xen-privcmd.ko 2023-03-03T07:28:12.566 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 74009 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/xen/xen-scsiback.ko 2023-03-03T07:28:12.566 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/xen/xenfs/ 2023-03-03T07:28:12.566 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18929 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/xen/xenfs/xenfs.ko 2023-03-03T07:28:12.566 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/ 2023-03-03T07:28:12.567 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/9p/ 2023-03-03T07:28:12.567 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 170937 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/9p/9p.ko 2023-03-03T07:28:12.567 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/adfs/ 2023-03-03T07:28:12.567 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 60769 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/adfs/adfs.ko 2023-03-03T07:28:12.567 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/affs/ 2023-03-03T07:28:12.567 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 162665 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/affs/affs.ko 2023-03-03T07:28:12.567 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/afs/ 2023-03-03T07:28:12.567 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 886529 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/afs/kafs.ko 2023-03-03T07:28:12.568 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/autofs/ 2023-03-03T07:28:12.568 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 100825 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/autofs/autofs4.ko 2023-03-03T07:28:12.568 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/befs/ 2023-03-03T07:28:12.568 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 64073 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/befs/befs.ko 2023-03-03T07:28:12.568 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/bfs/ 2023-03-03T07:28:12.568 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 41809 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/bfs/bfs.ko 2023-03-03T07:28:12.568 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34353 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/binfmt_misc.ko 2023-03-03T07:28:12.568 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/btrfs/ 2023-03-03T07:28:12.569 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 3478321 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/btrfs/btrfs.ko 2023-03-03T07:28:12.569 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/cachefiles/ 2023-03-03T07:28:12.569 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 293745 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/cachefiles/cachefiles.ko 2023-03-03T07:28:12.569 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/ceph/ 2023-03-03T07:28:12.569 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 1240393 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/ceph/ceph.ko 2023-03-03T07:28:12.569 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/cifs/ 2023-03-03T07:28:12.569 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 2600641 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/cifs/cifs.ko 2023-03-03T07:28:12.570 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/coda/ 2023-03-03T07:28:12.570 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 99745 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/coda/coda.ko 2023-03-03T07:28:12.570 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/configfs/ 2023-03-03T07:28:12.570 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 105777 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/configfs/configfs.ko 2023-03-03T07:28:12.570 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/cramfs/ 2023-03-03T07:28:12.570 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29873 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/cramfs/cramfs.ko 2023-03-03T07:28:12.570 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/dlm/ 2023-03-03T07:28:12.570 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 637665 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/dlm/dlm.ko 2023-03-03T07:28:12.571 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/efs/ 2023-03-03T07:28:12.571 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 37417 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/efs/efs.ko 2023-03-03T07:28:12.571 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/f2fs/ 2023-03-03T07:28:12.571 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 1485049 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/f2fs/f2fs.ko 2023-03-03T07:28:12.571 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/fat/ 2023-03-03T07:28:12.571 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27713 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/fat/msdos.ko 2023-03-03T07:28:12.571 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/freevxfs/ 2023-03-03T07:28:12.572 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 43737 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/freevxfs/freevxfs.ko 2023-03-03T07:28:12.572 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/fscache/ 2023-03-03T07:28:12.572 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 204017 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/fscache/fscache.ko 2023-03-03T07:28:12.572 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/fuse/ 2023-03-03T07:28:12.572 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24657 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/fuse/cuse.ko 2023-03-03T07:28:12.572 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/gfs2/ 2023-03-03T07:28:12.572 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 1234073 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/gfs2/gfs2.ko 2023-03-03T07:28:12.572 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/hfs/ 2023-03-03T07:28:12.573 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 144753 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/hfs/hfs.ko 2023-03-03T07:28:12.573 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/hfsplus/ 2023-03-03T07:28:12.573 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 229193 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/hfsplus/hfsplus.ko 2023-03-03T07:28:12.573 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/hpfs/ 2023-03-03T07:28:12.573 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 200097 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/hpfs/hpfs.ko 2023-03-03T07:28:12.573 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/isofs/ 2023-03-03T07:28:12.573 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 77113 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/isofs/isofs.ko 2023-03-03T07:28:12.573 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/jfs/ 2023-03-03T07:28:12.574 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 424905 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/jfs/jfs.ko 2023-03-03T07:28:12.574 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/lockd/ 2023-03-03T07:28:12.574 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 279945 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/lockd/lockd.ko 2023-03-03T07:28:12.574 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/minix/ 2023-03-03T07:28:12.574 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 88993 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/minix/minix.ko 2023-03-03T07:28:12.574 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/netfs/ 2023-03-03T07:28:12.574 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 113025 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/netfs/netfs.ko 2023-03-03T07:28:12.574 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nfs/ 2023-03-03T07:28:12.575 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nfs/blocklayout/ 2023-03-03T07:28:12.575 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 89729 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-03-03T07:28:12.575 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nfs/filelayout/ 2023-03-03T07:28:12.575 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 63393 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-03-03T07:28:12.575 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nfs/flexfilelayout/ 2023-03-03T07:28:12.575 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 125041 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-03-03T07:28:12.575 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 1072689 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nfs/nfs.ko 2023-03-03T07:28:12.576 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 69225 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nfs/nfsv2.ko 2023-03-03T07:28:12.576 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 124673 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nfs/nfsv3.ko 2023-03-03T07:28:12.576 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 2057697 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nfs/nfsv4.ko 2023-03-03T07:28:12.576 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nfs_common/ 2023-03-03T07:28:12.576 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18905 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nfs_common/grace.ko 2023-03-03T07:28:12.576 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15177 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nfs_common/nfs_acl.ko 2023-03-03T07:28:12.576 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nfsd/ 2023-03-03T07:28:12.576 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 1585681 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nfsd/nfsd.ko 2023-03-03T07:28:12.577 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nilfs2/ 2023-03-03T07:28:12.577 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 586265 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nilfs2/nilfs2.ko 2023-03-03T07:28:12.577 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/ 2023-03-03T07:28:12.577 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13297 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/mac-celtic.ko 2023-03-03T07:28:12.577 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12681 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/mac-centeuro.ko 2023-03-03T07:28:12.577 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13305 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/mac-croatian.ko 2023-03-03T07:28:12.577 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12369 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/mac-cyrillic.ko 2023-03-03T07:28:12.577 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12985 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/mac-gaelic.ko 2023-03-03T07:28:12.578 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12361 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/mac-greek.ko 2023-03-03T07:28:12.578 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13297 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/mac-iceland.ko 2023-03-03T07:28:12.578 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12673 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/mac-inuit.ko 2023-03-03T07:28:12.578 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13609 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/mac-roman.ko 2023-03-03T07:28:12.578 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13305 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/mac-romanian.ko 2023-03-03T07:28:12.578 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13297 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/mac-turkish.ko 2023-03-03T07:28:12.578 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10801 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_ascii.ko 2023-03-03T07:28:12.578 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12049 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_cp1250.ko 2023-03-03T07:28:12.579 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11737 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_cp1251.ko 2023-03-03T07:28:12.579 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12425 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_cp1255.ko 2023-03-03T07:28:12.579 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12049 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_cp737.ko 2023-03-03T07:28:12.579 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12049 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_cp775.ko 2023-03-03T07:28:12.579 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11737 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_cp850.ko 2023-03-03T07:28:12.579 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11737 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_cp852.ko 2023-03-03T07:28:12.579 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11737 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_cp855.ko 2023-03-03T07:28:12.579 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11425 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_cp857.ko 2023-03-03T07:28:12.580 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12361 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_cp860.ko 2023-03-03T07:28:12.580 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12665 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_cp861.ko 2023-03-03T07:28:12.580 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12977 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_cp862.ko 2023-03-03T07:28:12.580 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12665 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_cp863.ko 2023-03-03T07:28:12.580 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12361 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_cp864.ko 2023-03-03T07:28:12.580 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12665 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_cp865.ko 2023-03-03T07:28:12.580 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12049 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_cp866.ko 2023-03-03T07:28:12.581 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11737 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_cp869.ko 2023-03-03T07:28:12.581 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11497 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_cp874.ko 2023-03-03T07:28:12.581 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 93649 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_cp932.ko 2023-03-03T07:28:12.581 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 142185 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_cp936.ko 2023-03-03T07:28:12.581 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 165321 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_cp949.ko 2023-03-03T07:28:12.581 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 117625 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_cp950.ko 2023-03-03T07:28:12.581 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11969 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_euc-jp.ko 2023-03-03T07:28:12.581 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10809 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_iso8859-1.ko 2023-03-03T07:28:12.582 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11433 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_iso8859-13.ko 2023-03-03T07:28:12.582 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11433 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_iso8859-14.ko 2023-03-03T07:28:12.582 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11433 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_iso8859-15.ko 2023-03-03T07:28:12.582 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11433 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_iso8859-2.ko 2023-03-03T07:28:12.582 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11433 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_iso8859-3.ko 2023-03-03T07:28:12.582 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11433 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_iso8859-4.ko 2023-03-03T07:28:12.582 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11433 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_iso8859-5.ko 2023-03-03T07:28:12.583 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11121 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_iso8859-6.ko 2023-03-03T07:28:12.583 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11745 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_iso8859-7.ko 2023-03-03T07:28:12.583 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11121 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_iso8859-9.ko 2023-03-03T07:28:12.583 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12049 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_koi8-r.ko 2023-03-03T07:28:12.583 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7593 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_koi8-ru.ko 2023-03-03T07:28:12.585 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12049 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_koi8-u.ko 2023-03-03T07:28:12.585 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7849 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_utf8.ko 2023-03-03T07:28:12.586 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/ntfs/ 2023-03-03T07:28:12.586 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 219449 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/ntfs/ntfs.ko 2023-03-03T07:28:12.586 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/ocfs2/ 2023-03-03T07:28:12.586 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/ocfs2/cluster/ 2023-03-03T07:28:12.586 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 242329 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-03-03T07:28:12.586 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/ocfs2/dlm/ 2023-03-03T07:28:12.586 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 439761 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-03-03T07:28:12.586 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/ocfs2/dlmfs/ 2023-03-03T07:28:12.587 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 53473 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-03-03T07:28:12.587 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 2625897 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/ocfs2/ocfs2.ko 2023-03-03T07:28:12.587 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17809 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-03-03T07:28:12.587 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 32201 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-03-03T07:28:12.587 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34089 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-03-03T07:28:12.587 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/omfs/ 2023-03-03T07:28:12.587 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 53105 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/omfs/omfs.ko 2023-03-03T07:28:12.587 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/overlayfs/ 2023-03-03T07:28:12.588 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 334953 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/overlayfs/overlay.ko 2023-03-03T07:28:12.588 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/pstore/ 2023-03-03T07:28:12.588 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 56057 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/pstore/ramoops.ko 2023-03-03T07:28:12.588 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/qnx4/ 2023-03-03T07:28:12.588 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26969 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/qnx4/qnx4.ko 2023-03-03T07:28:12.588 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/qnx6/ 2023-03-03T07:28:12.588 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 48481 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/qnx6/qnx6.ko 2023-03-03T07:28:12.589 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/quota/ 2023-03-03T07:28:12.589 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29673 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/quota/quota_tree.ko 2023-03-03T07:28:12.589 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14177 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/quota/quota_v1.ko 2023-03-03T07:28:12.589 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21521 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/quota/quota_v2.ko 2023-03-03T07:28:12.589 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/reiserfs/ 2023-03-03T07:28:12.589 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 530121 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/reiserfs/reiserfs.ko 2023-03-03T07:28:12.589 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/romfs/ 2023-03-03T07:28:12.589 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28529 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/romfs/romfs.ko 2023-03-03T07:28:12.590 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/smbfs_common/ 2023-03-03T07:28:12.590 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 6361 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/smbfs_common/cifs_arc4.ko 2023-03-03T07:28:12.590 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10377 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/smbfs_common/cifs_md4.ko 2023-03-03T07:28:12.590 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/squashfs/ 2023-03-03T07:28:12.590 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 134969 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/squashfs/squashfs.ko 2023-03-03T07:28:12.590 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/sysv/ 2023-03-03T07:28:12.590 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 92681 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/sysv/sysv.ko 2023-03-03T07:28:12.590 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/udf/ 2023-03-03T07:28:12.591 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 253265 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/udf/udf.ko 2023-03-03T07:28:12.591 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/ufs/ 2023-03-03T07:28:12.591 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 162185 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/ufs/ufs.ko 2023-03-03T07:28:12.591 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/xfs/ 2023-03-03T07:28:12.591 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 3960561 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/xfs/xfs.ko 2023-03-03T07:28:12.591 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/kernel/ 2023-03-03T07:28:12.591 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/kernel/locking/ 2023-03-03T07:28:12.592 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 61625 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/kernel/locking/locktorture.ko 2023-03-03T07:28:12.592 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/kernel/time/ 2023-03-03T07:28:12.592 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13361 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/kernel/time/test_udelay.ko 2023-03-03T07:28:12.592 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 56377 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/kernel/torture.ko 2023-03-03T07:28:12.592 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/lib/ 2023-03-03T07:28:12.592 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 6033 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/lib/crc-itu-t.ko 2023-03-03T07:28:12.592 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 5729 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/lib/crc7.ko 2023-03-03T07:28:12.592 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 6081 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/lib/crc8.ko 2023-03-03T07:28:12.593 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/lib/crypto/ 2023-03-03T07:28:12.593 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 6305 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/lib/crypto/libarc4.ko 2023-03-03T07:28:12.593 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 35897 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/lib/crypto/libdes.ko 2023-03-03T07:28:12.593 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13033 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/lib/interval_tree_test.ko 2023-03-03T07:28:12.593 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8121 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/lib/libcrc32c.ko 2023-03-03T07:28:12.593 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22953 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/lib/lru_cache.ko 2023-03-03T07:28:12.593 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/lib/lz4/ 2023-03-03T07:28:12.593 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 32593 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/lib/lz4/lz4_compress.ko 2023-03-03T07:28:12.594 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21657 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/lib/lz4/lz4hc_compress.ko 2023-03-03T07:28:12.594 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/lib/math/ 2023-03-03T07:28:12.594 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 5897 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/lib/math/cordic.ko 2023-03-03T07:28:12.594 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7793 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/lib/memory-notifier-error-inject.ko 2023-03-03T07:28:12.594 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10433 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/lib/notifier-error-inject.ko 2023-03-03T07:28:12.594 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19633 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/lib/percpu_test.ko 2023-03-03T07:28:12.594 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7865 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/lib/pm-notifier-error-inject.ko 2023-03-03T07:28:12.594 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/lib/raid6/ 2023-03-03T07:28:12.595 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 141425 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/lib/raid6/raid6_pq.ko 2023-03-03T07:28:12.595 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18473 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/lib/rbtree_test.ko 2023-03-03T07:28:12.595 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/lib/reed_solomon/ 2023-03-03T07:28:12.595 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17641 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/lib/reed_solomon/reed_solomon.ko 2023-03-03T07:28:12.595 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 36961 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/lib/test-kstrtox.ko 2023-03-03T07:28:12.595 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24785 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/lib/test-string_helpers.ko 2023-03-03T07:28:12.595 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 4759153 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/lib/test_bpf.ko 2023-03-03T07:28:12.596 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 49489 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/lib/test_firmware.ko 2023-03-03T07:28:12.596 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 5873 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/lib/test_module.ko 2023-03-03T07:28:12.596 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20785 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/lib/test_user_copy.ko 2023-03-03T07:28:12.596 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9161 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/lib/ts_bm.ko 2023-03-03T07:28:12.596 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10625 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/lib/ts_fsm.ko 2023-03-03T07:28:12.596 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9201 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/lib/ts_kmp.ko 2023-03-03T07:28:12.596 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/lib/xz/ 2023-03-03T07:28:12.596 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13273 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/lib/xz/xz_dec_test.ko 2023-03-03T07:28:12.597 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/mm/ 2023-03-03T07:28:12.597 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15353 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/mm/hwpoison-inject.ko 2023-03-03T07:28:12.597 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ 2023-03-03T07:28:12.597 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/6lowpan/ 2023-03-03T07:28:12.597 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 54273 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/6lowpan/6lowpan.ko 2023-03-03T07:28:12.597 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 6553 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/6lowpan/nhc_dest.ko 2023-03-03T07:28:12.597 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 6577 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/6lowpan/nhc_fragment.ko 2023-03-03T07:28:12.597 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 6553 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/6lowpan/nhc_hop.ko 2023-03-03T07:28:12.598 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 6553 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/6lowpan/nhc_ipv6.ko 2023-03-03T07:28:12.598 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 6577 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/6lowpan/nhc_mobility.ko 2023-03-03T07:28:12.598 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 6577 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/6lowpan/nhc_routing.ko 2023-03-03T07:28:12.598 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15065 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/6lowpan/nhc_udp.ko 2023-03-03T07:28:12.598 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/802/ 2023-03-03T07:28:12.598 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28857 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/802/garp.ko 2023-03-03T07:28:12.598 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33265 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/802/mrp.ko 2023-03-03T07:28:12.598 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7729 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/802/p8022.ko 2023-03-03T07:28:12.599 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14977 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/802/psnap.ko 2023-03-03T07:28:12.599 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10673 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/802/stp.ko 2023-03-03T07:28:12.599 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/8021q/ 2023-03-03T07:28:12.599 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 86249 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/8021q/8021q.ko 2023-03-03T07:28:12.599 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/9p/ 2023-03-03T07:28:12.599 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 178153 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/9p/9pnet.ko 2023-03-03T07:28:12.599 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 36401 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/9p/9pnet_fd.ko 2023-03-03T07:28:12.600 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26225 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/9p/9pnet_rdma.ko 2023-03-03T07:28:12.600 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 32049 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/9p/9pnet_virtio.ko 2023-03-03T07:28:12.600 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/batman-adv/ 2023-03-03T07:28:12.600 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 651577 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/batman-adv/batman-adv.ko 2023-03-03T07:28:12.600 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/bridge/ 2023-03-03T07:28:12.600 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 84849 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/bridge/br_netfilter.ko 2023-03-03T07:28:12.600 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 755113 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/bridge/bridge.ko 2023-03-03T07:28:12.600 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/bridge/netfilter/ 2023-03-03T07:28:12.601 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7233 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-03-03T07:28:12.601 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12369 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/bridge/netfilter/ebt_among.ko 2023-03-03T07:28:12.601 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8673 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/bridge/netfilter/ebt_arp.ko 2023-03-03T07:28:12.601 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8585 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-03-03T07:28:12.601 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9169 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-03-03T07:28:12.601 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8249 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/bridge/netfilter/ebt_ip.ko 2023-03-03T07:28:12.601 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8649 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-03-03T07:28:12.601 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9689 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/bridge/netfilter/ebt_limit.ko 2023-03-03T07:28:12.602 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12745 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/bridge/netfilter/ebt_log.ko 2023-03-03T07:28:12.602 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8505 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/bridge/netfilter/ebt_mark.ko 2023-03-03T07:28:12.602 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8761 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-03-03T07:28:12.602 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7897 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-03-03T07:28:12.602 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7113 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-03-03T07:28:12.602 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9065 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-03-03T07:28:12.602 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8225 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/bridge/netfilter/ebt_snat.ko 2023-03-03T07:28:12.603 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8393 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/bridge/netfilter/ebt_stp.ko 2023-03-03T07:28:12.603 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11849 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-03-03T07:28:12.603 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10977 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-03-03T07:28:12.603 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9369 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-03-03T07:28:12.603 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9345 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-03-03T07:28:12.603 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 79953 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/bridge/netfilter/ebtables.ko 2023-03-03T07:28:12.603 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12497 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-03-03T07:28:12.603 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13313 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-03-03T07:28:12.604 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ceph/ 2023-03-03T07:28:12.604 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 1047633 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ceph/libceph.ko 2023-03-03T07:28:12.604 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/core/ 2023-03-03T07:28:12.604 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 129729 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/core/pktgen.ko 2023-03-03T07:28:12.604 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/dccp/ 2023-03-03T07:28:12.604 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 192145 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/dccp/dccp.ko 2023-03-03T07:28:12.604 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8225 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/dccp/dccp_diag.ko 2023-03-03T07:28:12.604 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 59065 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/dccp/dccp_ipv4.ko 2023-03-03T07:28:12.605 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 60233 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/dccp/dccp_ipv6.ko 2023-03-03T07:28:12.605 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/dsa/ 2023-03-03T07:28:12.605 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 276553 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/dsa/dsa_core.ko 2023-03-03T07:28:12.605 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12913 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/dsa/tag_brcm.ko 2023-03-03T07:28:12.605 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12081 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/dsa/tag_dsa.ko 2023-03-03T07:28:12.605 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7225 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/dsa/tag_none.ko 2023-03-03T07:28:12.605 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8465 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/dsa/tag_trailer.ko 2023-03-03T07:28:12.605 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/hsr/ 2023-03-03T07:28:12.606 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 99145 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/hsr/hsr.ko 2023-03-03T07:28:12.606 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ieee802154/ 2023-03-03T07:28:12.606 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ieee802154/6lowpan/ 2023-03-03T07:28:12.606 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 45217 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-03-03T07:28:12.606 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 214049 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ieee802154/ieee802154.ko 2023-03-03T07:28:12.606 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 47185 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ieee802154/ieee802154_socket.ko 2023-03-03T07:28:12.606 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/ 2023-03-03T07:28:12.607 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24297 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/ah4.ko 2023-03-03T07:28:12.607 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 37977 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/esp4.ko 2023-03-03T07:28:12.607 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 49169 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/fou.ko 2023-03-03T07:28:12.607 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17121 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/gre.ko 2023-03-03T07:28:12.607 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 46481 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/inet_diag.ko 2023-03-03T07:28:12.607 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 65561 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/ip_gre.ko 2023-03-03T07:28:12.607 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 65033 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/ip_tunnel.ko 2023-03-03T07:28:12.607 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 35497 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/ip_vti.ko 2023-03-03T07:28:12.608 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13577 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/ipcomp.ko 2023-03-03T07:28:12.608 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28385 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/ipip.ko 2023-03-03T07:28:12.608 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/netfilter/ 2023-03-03T07:28:12.608 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 47609 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/netfilter/arp_tables.ko 2023-03-03T07:28:12.608 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8385 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-03-03T07:28:12.608 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9889 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-03-03T07:28:12.608 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 54849 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/netfilter/ip_tables.ko 2023-03-03T07:28:12.608 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 48777 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/netfilter/ipt_CLUSTERIP.ko 2023-03-03T07:28:12.609 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9905 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-03-03T07:28:12.609 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9497 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-03-03T07:28:12.609 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15577 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-03-03T07:28:12.609 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10681 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-03-03T07:28:12.609 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14785 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-03-03T07:28:12.609 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10793 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-03-03T07:28:12.609 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11129 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-03-03T07:28:12.609 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15025 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-03-03T07:28:12.610 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11081 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-03-03T07:28:12.610 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9897 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/netfilter/iptable_security.ko 2023-03-03T07:28:12.610 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11281 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-03-03T07:28:12.610 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8481 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-03-03T07:28:12.610 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27961 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-03-03T07:28:12.610 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17617 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-03-03T07:28:12.610 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12913 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-03-03T07:28:12.611 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19129 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-03-03T07:28:12.611 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8665 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-03-03T07:28:12.611 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13865 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-03-03T07:28:12.611 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9465 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-03-03T07:28:12.611 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16193 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-03-03T07:28:12.611 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8505 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-03-03T07:28:12.611 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12577 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/tcp_bic.ko 2023-03-03T07:28:12.611 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13241 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/tcp_dctcp.ko 2023-03-03T07:28:12.612 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14457 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/tcp_diag.ko 2023-03-03T07:28:12.612 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9105 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/tcp_highspeed.ko 2023-03-03T07:28:12.612 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11897 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/tcp_htcp.ko 2023-03-03T07:28:12.612 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9953 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/tcp_hybla.ko 2023-03-03T07:28:12.612 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10977 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/tcp_illinois.ko 2023-03-03T07:28:12.612 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9993 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/tcp_lp.ko 2023-03-03T07:28:12.612 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7841 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/tcp_scalable.ko 2023-03-03T07:28:12.612 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13305 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/tcp_vegas.ko 2023-03-03T07:28:12.613 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9665 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/tcp_veno.ko 2023-03-03T07:28:12.613 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10465 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/tcp_westwood.ko 2023-03-03T07:28:12.613 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9689 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/tcp_yeah.ko 2023-03-03T07:28:12.613 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21297 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/tunnel4.ko 2023-03-03T07:28:12.613 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15697 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/udp_diag.ko 2023-03-03T07:28:12.613 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 40105 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/udp_tunnel.ko 2023-03-03T07:28:12.613 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10929 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/xfrm4_tunnel.ko 2023-03-03T07:28:12.614 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/ 2023-03-03T07:28:12.614 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26353 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/ah6.ko 2023-03-03T07:28:12.614 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 38713 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/esp6.ko 2023-03-03T07:28:12.614 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13809 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/fou6.ko 2023-03-03T07:28:12.614 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 96425 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/ip6_gre.ko 2023-03-03T07:28:12.614 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 102673 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/ip6_tunnel.ko 2023-03-03T07:28:12.614 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10177 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-03-03T07:28:12.614 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 63473 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/ip6_vti.ko 2023-03-03T07:28:12.615 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13297 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/ipcomp6.ko 2023-03-03T07:28:12.615 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18593 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/mip6.ko 2023-03-03T07:28:12.615 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/netfilter/ 2023-03-03T07:28:12.615 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 55449 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-03-03T07:28:12.615 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11329 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-03-03T07:28:12.615 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9681 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-03-03T07:28:12.615 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15657 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-03-03T07:28:12.615 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13833 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-03-03T07:28:12.616 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7305 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-03-03T07:28:12.616 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15777 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-03-03T07:28:12.616 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15537 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-03-03T07:28:12.616 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8417 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-03-03T07:28:12.616 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9393 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-03-03T07:28:12.616 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10865 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-03-03T07:28:12.616 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10401 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-03-03T07:28:12.616 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10801 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-03-03T07:28:12.617 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10609 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-03-03T07:28:12.617 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15129 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-03-03T07:28:12.617 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11097 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-03-03T07:28:12.617 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9913 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-03-03T07:28:12.617 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 43289 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-03-03T07:28:12.617 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8041 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-03-03T07:28:12.617 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24497 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-03-03T07:28:12.618 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9137 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-03-03T07:28:12.618 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14201 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-03-03T07:28:12.618 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9201 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-03-03T07:28:12.618 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15217 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-03-03T07:28:12.618 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8577 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-03-03T07:28:12.618 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 90585 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/sit.ko 2023-03-03T07:28:12.618 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22737 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/tunnel6.ko 2023-03-03T07:28:12.618 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27865 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/xfrm6_tunnel.ko 2023-03-03T07:28:12.619 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/key/ 2023-03-03T07:28:12.619 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 92481 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/key/af_key.ko 2023-03-03T07:28:12.619 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/l2tp/ 2023-03-03T07:28:12.619 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 133505 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/l2tp/l2tp_core.ko 2023-03-03T07:28:12.619 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19729 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/l2tp/l2tp_debugfs.ko 2023-03-03T07:28:12.619 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24729 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/l2tp/l2tp_eth.ko 2023-03-03T07:28:12.619 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34649 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/l2tp/l2tp_ip.ko 2023-03-03T07:28:12.619 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 36281 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/l2tp/l2tp_ip6.ko 2023-03-03T07:28:12.620 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 32185 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/l2tp/l2tp_netlink.ko 2023-03-03T07:28:12.620 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 52177 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/l2tp/l2tp_ppp.ko 2023-03-03T07:28:12.620 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/lapb/ 2023-03-03T07:28:12.620 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 46593 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/lapb/lapb.ko 2023-03-03T07:28:12.620 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/llc/ 2023-03-03T07:28:12.620 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21713 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/llc/llc.ko 2023-03-03T07:28:12.620 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 266329 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/llc/llc2.ko 2023-03-03T07:28:12.620 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/mac802154/ 2023-03-03T07:28:12.621 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 238257 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/mac802154/mac802154.ko 2023-03-03T07:28:12.621 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/mpls/ 2023-03-03T07:28:12.621 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8897 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/mpls/mpls_gso.ko 2023-03-03T07:28:12.621 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ 2023-03-03T07:28:12.621 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipset/ 2023-03-03T07:28:12.621 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 135785 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipset/ip_set.ko 2023-03-03T07:28:12.621 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27793 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-03-03T07:28:12.622 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26369 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-03-03T07:28:12.622 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25865 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-03-03T07:28:12.622 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 101393 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-03-03T07:28:12.622 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 102569 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-03-03T07:28:12.622 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 104065 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-03-03T07:28:12.622 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 104529 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-03-03T07:28:12.622 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 112081 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-03-03T07:28:12.622 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 60705 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-03-03T07:28:12.623 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 108729 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-03-03T07:28:12.623 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 112361 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-03-03T07:28:12.623 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 111865 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-03-03T07:28:12.623 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 110785 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-03-03T07:28:12.623 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 113737 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-03-03T07:28:12.623 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29505 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-03-03T07:28:12.623 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipvs/ 2023-03-03T07:28:12.623 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 407209 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipvs/ip_vs.ko 2023-03-03T07:28:12.624 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11401 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-03-03T07:28:12.624 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7129 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-03-03T07:28:12.624 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17225 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-03-03T07:28:12.624 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17409 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-03-03T07:28:12.624 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20177 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-03-03T07:28:12.624 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7193 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-03-03T07:28:12.624 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7257 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-03-03T07:28:12.624 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10185 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-03-03T07:28:12.625 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8801 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-03-03T07:28:12.625 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7209 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-03-03T07:28:12.625 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12953 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-03-03T07:28:12.625 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7273 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-03-03T07:28:12.625 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10497 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-03-03T07:28:12.625 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 47393 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nf_conncount.ko 2023-03-03T07:28:12.625 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 429161 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nf_conntrack.ko 2023-03-03T07:28:12.626 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15401 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-03-03T07:28:12.626 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9345 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-03-03T07:28:12.626 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 32713 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-03-03T07:28:12.626 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 116537 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nf_conntrack_h323.ko 2023-03-03T07:28:12.626 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21473 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nf_conntrack_irc.ko 2023-03-03T07:28:12.626 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8377 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-03-03T07:28:12.626 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 105961 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-03-03T07:28:12.626 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 32673 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-03-03T07:28:12.627 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16665 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nf_conntrack_sane.ko 2023-03-03T07:28:12.627 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 64865 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nf_conntrack_sip.ko 2023-03-03T07:28:12.627 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10425 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-03-03T07:28:12.627 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18201 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-03-03T07:28:12.627 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9633 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nf_dup_netdev.ko 2023-03-03T07:28:12.627 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 85633 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nf_flow_table.ko 2023-03-03T07:28:12.627 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9161 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nf_flow_table_inet.ko 2023-03-03T07:28:12.627 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 36577 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nf_log_syslog.ko 2023-03-03T07:28:12.628 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 91809 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nf_nat.ko 2023-03-03T07:28:12.628 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9625 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nf_nat_amanda.ko 2023-03-03T07:28:12.628 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12305 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nf_nat_ftp.ko 2023-03-03T07:28:12.628 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11537 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nf_nat_irc.ko 2023-03-03T07:28:12.628 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28497 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nf_nat_sip.ko 2023-03-03T07:28:12.628 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8305 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nf_nat_tftp.ko 2023-03-03T07:28:12.628 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 51305 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nf_synproxy_core.ko 2023-03-03T07:28:12.629 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 644793 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nf_tables.ko 2023-03-03T07:28:12.629 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 50457 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nfnetlink.ko 2023-03-03T07:28:12.629 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34825 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nfnetlink_acct.ko 2023-03-03T07:28:12.629 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 37305 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-03-03T07:28:12.629 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 47201 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nfnetlink_log.ko 2023-03-03T07:28:12.629 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21409 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nfnetlink_osf.ko 2023-03-03T07:28:12.629 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 61729 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nfnetlink_queue.ko 2023-03-03T07:28:12.629 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9961 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nft_chain_nat.ko 2023-03-03T07:28:12.630 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33001 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nft_compat.ko 2023-03-03T07:28:12.630 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 40121 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nft_ct.ko 2023-03-03T07:28:12.630 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9169 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nft_dup_netdev.ko 2023-03-03T07:28:12.630 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10161 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nft_fib.ko 2023-03-03T07:28:12.630 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13321 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nft_fwd_netdev.ko 2023-03-03T07:28:12.630 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13681 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nft_hash.ko 2023-03-03T07:28:12.630 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19545 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nft_limit.ko 2023-03-03T07:28:12.630 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14905 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nft_log.ko 2023-03-03T07:28:12.631 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14753 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nft_masq.ko 2023-03-03T07:28:12.631 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13889 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nft_nat.ko 2023-03-03T07:28:12.631 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13241 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nft_numgen.ko 2023-03-03T07:28:12.631 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11289 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nft_osf.ko 2023-03-03T07:28:12.631 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13641 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nft_queue.ko 2023-03-03T07:28:12.631 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14305 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nft_redir.ko 2023-03-03T07:28:12.631 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9289 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nft_reject.ko 2023-03-03T07:28:12.631 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9585 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nft_reject_inet.ko 2023-03-03T07:28:12.632 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12297 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nft_socket.ko 2023-03-03T07:28:12.632 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22913 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nft_synproxy.ko 2023-03-03T07:28:12.632 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14417 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nft_tproxy.ko 2023-03-03T07:28:12.632 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 105865 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/x_tables.ko 2023-03-03T07:28:12.632 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11881 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_AUDIT.ko 2023-03-03T07:28:12.632 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9561 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_CHECKSUM.ko 2023-03-03T07:28:12.632 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7305 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_CLASSIFY.ko 2023-03-03T07:28:12.632 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11505 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-03-03T07:28:12.633 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18161 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_CT.ko 2023-03-03T07:28:12.633 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10137 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_DSCP.ko 2023-03-03T07:28:12.633 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9041 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_HL.ko 2023-03-03T07:28:12.633 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13265 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_HMARK.ko 2023-03-03T07:28:12.633 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 38377 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_IDLETIMER.ko 2023-03-03T07:28:12.633 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13833 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_LED.ko 2023-03-03T07:28:12.633 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11057 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_LOG.ko 2023-03-03T07:28:12.634 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11289 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_MASQUERADE.ko 2023-03-03T07:28:12.634 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11297 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_NETMAP.ko 2023-03-03T07:28:12.634 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8977 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_NFLOG.ko 2023-03-03T07:28:12.634 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13161 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_NFQUEUE.ko 2023-03-03T07:28:12.634 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21929 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_RATEEST.ko 2023-03-03T07:28:12.634 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10313 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_REDIRECT.ko 2023-03-03T07:28:12.634 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14529 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_SECMARK.ko 2023-03-03T07:28:12.634 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16297 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_TCPMSS.ko 2023-03-03T07:28:12.635 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9937 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-03-03T07:28:12.635 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19801 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_TEE.ko 2023-03-03T07:28:12.635 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16617 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_TPROXY.ko 2023-03-03T07:28:12.635 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7833 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_TRACE.ko 2023-03-03T07:28:12.635 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13713 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_addrtype.ko 2023-03-03T07:28:12.635 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13977 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_bpf.ko 2023-03-03T07:28:12.635 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16745 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_cgroup.ko 2023-03-03T07:28:12.635 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11217 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_cluster.ko 2023-03-03T07:28:12.636 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7073 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_comment.ko 2023-03-03T07:28:12.636 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10257 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_connbytes.ko 2023-03-03T07:28:12.636 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11169 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_connlabel.ko 2023-03-03T07:28:12.636 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8913 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_connlimit.ko 2023-03-03T07:28:12.636 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13241 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_connmark.ko 2023-03-03T07:28:12.636 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12393 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_conntrack.ko 2023-03-03T07:28:12.636 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7505 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_cpu.ko 2023-03-03T07:28:12.636 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10409 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_dccp.ko 2023-03-03T07:28:12.637 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7369 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_devgroup.ko 2023-03-03T07:28:12.637 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8433 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_dscp.ko 2023-03-03T07:28:12.637 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10641 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_ecn.ko 2023-03-03T07:28:12.637 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11041 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_esp.ko 2023-03-03T07:28:12.637 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 50401 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_hashlimit.ko 2023-03-03T07:28:12.637 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11313 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_helper.ko 2023-03-03T07:28:12.637 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7433 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_hl.ko 2023-03-03T07:28:12.638 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11833 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_ipcomp.ko 2023-03-03T07:28:12.638 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11033 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_iprange.ko 2023-03-03T07:28:12.638 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11529 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_ipvs.ko 2023-03-03T07:28:12.638 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16505 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_l2tp.ko 2023-03-03T07:28:12.638 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7505 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_length.ko 2023-03-03T07:28:12.638 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11257 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_limit.ko 2023-03-03T07:28:12.638 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7113 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_mac.ko 2023-03-03T07:28:12.638 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8129 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_mark.ko 2023-03-03T07:28:12.639 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11393 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_multiport.ko 2023-03-03T07:28:12.639 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13897 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_nat.ko 2023-03-03T07:28:12.639 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9969 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_nfacct.ko 2023-03-03T07:28:12.639 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7865 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_osf.ko 2023-03-03T07:28:12.639 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9081 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_owner.ko 2023-03-03T07:28:12.639 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9585 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_physdev.ko 2023-03-03T07:28:12.639 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7137 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_pkttype.ko 2023-03-03T07:28:12.639 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11713 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_policy.ko 2023-03-03T07:28:12.640 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9049 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_quota.ko 2023-03-03T07:28:12.640 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9913 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_rateest.ko 2023-03-03T07:28:12.640 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7761 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_realm.ko 2023-03-03T07:28:12.640 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 41633 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_recent.ko 2023-03-03T07:28:12.640 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12897 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_sctp.ko 2023-03-03T07:28:12.640 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31201 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_set.ko 2023-03-03T07:28:12.640 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16089 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_socket.ko 2023-03-03T07:28:12.640 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9433 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_state.ko 2023-03-03T07:28:12.641 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8985 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_statistic.ko 2023-03-03T07:28:12.641 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8313 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_string.ko 2023-03-03T07:28:12.641 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8129 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_tcpmss.ko 2023-03-03T07:28:12.641 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13305 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_tcpudp.ko 2023-03-03T07:28:12.641 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10833 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_time.ko 2023-03-03T07:28:12.641 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8617 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_u32.ko 2023-03-03T07:28:12.641 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netlink/ 2023-03-03T07:28:12.641 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13417 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netlink/netlink_diag.ko 2023-03-03T07:28:12.642 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/nsh/ 2023-03-03T07:28:12.642 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11753 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/nsh/nsh.ko 2023-03-03T07:28:12.642 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/openvswitch/ 2023-03-03T07:28:12.642 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 400273 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/openvswitch/openvswitch.ko 2023-03-03T07:28:12.642 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9825 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/openvswitch/vport-geneve.ko 2023-03-03T07:28:12.642 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8953 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/openvswitch/vport-gre.ko 2023-03-03T07:28:12.642 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11297 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/openvswitch/vport-vxlan.ko 2023-03-03T07:28:12.643 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/packet/ 2023-03-03T07:28:12.643 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12561 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/packet/af_packet_diag.ko 2023-03-03T07:28:12.643 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/phonet/ 2023-03-03T07:28:12.643 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 124025 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/phonet/phonet.ko 2023-03-03T07:28:12.643 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 52937 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/phonet/pn_pep.ko 2023-03-03T07:28:12.643 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/rds/ 2023-03-03T07:28:12.643 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 251929 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/rds/rds.ko 2023-03-03T07:28:12.643 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 172945 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/rds/rds_rdma.ko 2023-03-03T07:28:12.644 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 70913 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/rds/rds_tcp.ko 2023-03-03T07:28:12.644 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/rxrpc/ 2023-03-03T07:28:12.644 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 781177 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/rxrpc/rxrpc.ko 2023-03-03T07:28:12.644 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/ 2023-03-03T07:28:12.644 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33473 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/act_csum.ko 2023-03-03T07:28:12.644 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25305 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/act_gact.ko 2023-03-03T07:28:12.644 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29753 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/act_ipt.ko 2023-03-03T07:28:12.644 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 35945 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/act_mirred.ko 2023-03-03T07:28:12.645 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22777 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/act_nat.ko 2023-03-03T07:28:12.645 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28897 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/act_pedit.ko 2023-03-03T07:28:12.645 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33185 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/act_police.ko 2023-03-03T07:28:12.645 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21681 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/act_simple.ko 2023-03-03T07:28:12.645 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 44817 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/act_skbedit.ko 2023-03-03T07:28:12.645 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 37825 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/act_vlan.ko 2023-03-03T07:28:12.645 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24937 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/cls_basic.ko 2023-03-03T07:28:12.645 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 32569 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/cls_bpf.ko 2023-03-03T07:28:12.646 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18369 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/cls_cgroup.ko 2023-03-03T07:28:12.646 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30641 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/cls_flow.ko 2023-03-03T07:28:12.646 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28993 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/cls_fw.ko 2023-03-03T07:28:12.646 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 35577 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/cls_route.ko 2023-03-03T07:28:12.646 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 35321 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/cls_rsvp.ko 2023-03-03T07:28:12.646 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 35033 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/cls_rsvp6.ko 2023-03-03T07:28:12.646 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 42041 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/cls_tcindex.ko 2023-03-03T07:28:12.647 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 56441 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/cls_u32.ko 2023-03-03T07:28:12.647 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 6945 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/em_cmp.ko 2023-03-03T07:28:12.647 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12857 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/em_ipset.ko 2023-03-03T07:28:12.647 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 32785 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/em_meta.ko 2023-03-03T07:28:12.647 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7393 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/em_nbyte.ko 2023-03-03T07:28:12.647 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10129 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/em_text.ko 2023-03-03T07:28:12.647 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 6753 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/em_u32.ko 2023-03-03T07:28:12.647 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 43737 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/sch_cbq.ko 2023-03-03T07:28:12.648 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19609 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/sch_choke.ko 2023-03-03T07:28:12.648 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19201 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/sch_codel.ko 2023-03-03T07:28:12.648 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30393 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/sch_drr.ko 2023-03-03T07:28:12.648 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 32753 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/sch_dsmark.ko 2023-03-03T07:28:12.648 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30153 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/sch_fq.ko 2023-03-03T07:28:12.648 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28929 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/sch_fq_codel.ko 2023-03-03T07:28:12.648 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 32729 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/sch_gred.ko 2023-03-03T07:28:12.648 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 44273 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/sch_hfsc.ko 2023-03-03T07:28:12.649 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20369 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/sch_hhf.ko 2023-03-03T07:28:12.649 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 63257 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/sch_htb.ko 2023-03-03T07:28:12.649 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15137 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/sch_ingress.ko 2023-03-03T07:28:12.649 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22113 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/sch_mqprio.ko 2023-03-03T07:28:12.649 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23393 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/sch_multiq.ko 2023-03-03T07:28:12.649 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33649 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/sch_netem.ko 2023-03-03T07:28:12.649 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23497 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/sch_pie.ko 2023-03-03T07:28:12.649 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9769 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/sch_plug.ko 2023-03-03T07:28:12.650 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22769 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/sch_prio.ko 2023-03-03T07:28:12.650 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 44409 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/sch_qfq.ko 2023-03-03T07:28:12.650 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28609 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/sch_red.ko 2023-03-03T07:28:12.650 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24769 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/sch_sfb.ko 2023-03-03T07:28:12.650 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27897 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/sch_sfq.ko 2023-03-03T07:28:12.650 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27209 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/sch_tbf.ko 2023-03-03T07:28:12.650 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26641 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/sch_teql.ko 2023-03-03T07:28:12.650 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sctp/ 2023-03-03T07:28:12.651 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 921329 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sctp/sctp.ko 2023-03-03T07:28:12.651 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18537 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sctp/sctp_diag.ko 2023-03-03T07:28:12.651 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sunrpc/ 2023-03-03T07:28:12.651 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sunrpc/auth_gss/ 2023-03-03T07:28:12.651 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 339241 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-03-03T07:28:12.651 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 63193 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-03-03T07:28:12.651 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 1476289 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sunrpc/sunrpc.ko 2023-03-03T07:28:12.652 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sunrpc/xprtrdma/ 2023-03-03T07:28:12.652 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 720761 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-03-03T07:28:12.652 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/tipc/ 2023-03-03T07:28:12.652 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9529 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/tipc/diag.ko 2023-03-03T07:28:12.652 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 1123321 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/tipc/tipc.ko 2023-03-03T07:28:12.652 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/unix/ 2023-03-03T07:28:12.652 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15233 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/unix/unix_diag.ko 2023-03-03T07:28:12.652 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/vmw_vsock/ 2023-03-03T07:28:12.653 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 77785 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-03-03T07:28:12.653 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 68289 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-03-03T07:28:12.653 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 82433 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/vmw_vsock/vsock.ko 2023-03-03T07:28:12.653 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10209 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/vmw_vsock/vsock_diag.ko 2023-03-03T07:28:12.653 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18393 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/vmw_vsock/vsock_loopback.ko 2023-03-03T07:28:12.653 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/x25/ 2023-03-03T07:28:12.653 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 125817 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/x25/x25.ko 2023-03-03T07:28:12.653 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/xfrm/ 2023-03-03T07:28:12.654 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20793 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/xfrm/xfrm_algo.ko 2023-03-03T07:28:12.654 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20009 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/xfrm/xfrm_ipcomp.ko 2023-03-03T07:28:12.654 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 101665 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/xfrm/xfrm_user.ko 2023-03-03T07:28:12.654 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/virt/ 2023-03-03T07:28:12.654 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/virt/lib/ 2023-03-03T07:28:12.654 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14433 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/virt/lib/irqbypass.ko 2023-03-03T07:28:12.654 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 633131 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/modules.alias 2023-03-03T07:28:12.655 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 619504 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/modules.alias.bin 2023-03-03T07:28:12.655 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8377 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/modules.builtin 2023-03-03T07:28:12.655 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22490 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/modules.builtin.alias.bin 2023-03-03T07:28:12.655 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10648 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/modules.builtin.bin 2023-03-03T07:28:12.655 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 69838 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/modules.builtin.modinfo 2023-03-03T07:28:12.655 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 147260 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/modules.dep 2023-03-03T07:28:12.655 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 234530 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/modules.dep.bin 2023-03-03T07:28:12.655 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 210 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/modules.devname 2023-03-03T07:28:12.656 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 73341 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/modules.order 2023-03-03T07:28:12.656 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 830 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/modules.softdep 2023-03-03T07:28:12.656 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 250429 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/modules.symbols 2023-03-03T07:28:12.656 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 304835 2023-03-03 04:49 ./lib/modules/6.2.0-ceph-g75534f74ac3d/modules.symbols.bin 2023-03-03T07:28:12.656 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./usr/ 2023-03-03T07:28:12.656 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./usr/share/ 2023-03-03T07:28:12.656 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./usr/share/doc/ 2023-03-03T07:28:12.656 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-03-03 04:49 ./usr/share/doc/linux-image-6.2.0-ceph-g75534f74ac3d/ 2023-03-03T07:28:12.657 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 176 2023-03-03 04:49 ./usr/share/doc/linux-image-6.2.0-ceph-g75534f74ac3d/changelog.Debian.gz 2023-03-03T07:28:12.657 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 692 2023-03-03 04:49 ./usr/share/doc/linux-image-6.2.0-ceph-g75534f74ac3d/copyright 2023-03-03T07:28:12.658 DEBUG:teuthology.task.kernel:get_image_version: 6.2.0-ceph-g75534f74ac3d 2023-03-03T07:28:12.658 INFO:teuthology.task.kernel:searching for kernel 6.2.0-ceph-g75534f74ac3d 2023-03-03T07:28:12.658 DEBUG:teuthology.orchestra.run.smithi057:> egrep '(submenu|menuentry.*6.2.0-ceph-g75534f74ac3d).*{' /boot/grub/grub.cfg 2023-03-03T07:28:12.665 INFO:teuthology.orchestra.run.smithi057.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-03-03T07:28:12.665 INFO:teuthology.orchestra.run.smithi057.stdout: menuentry 'Ubuntu, with Linux 6.2.0-ceph-g75534f74ac3d' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.2.0-ceph-g75534f74ac3d-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-03-03T07:28:12.665 INFO:teuthology.orchestra.run.smithi057.stdout: menuentry 'Ubuntu, with Linux 6.2.0-ceph-g75534f74ac3d (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.2.0-ceph-g75534f74ac3d-recovery-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-03-03T07:28:12.666 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-03-03T07:28:12.666 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.2.0-ceph-g75534f74ac3d 2023-03-03T07:28:12.666 DEBUG:teuthology.orchestra.run.smithi057:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-03-03T07:28:12.668 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi057.front.sepia.ceph.com to complete... 2023-03-03T07:28:13.436 INFO:teuthology.orchestra.run.smithi057.stderr:Sourcing file `/etc/default/grub' 2023-03-03T07:28:13.448 INFO:teuthology.orchestra.run.smithi057.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-03-03T07:28:13.464 INFO:teuthology.orchestra.run.smithi057.stderr:Generating grub configuration file ... 2023-03-03T07:28:13.733 INFO:teuthology.orchestra.run.smithi057.stderr:Found linux image: /boot/vmlinuz-6.2.0-ceph-g75534f74ac3d 2023-03-03T07:28:13.745 INFO:teuthology.orchestra.run.smithi057.stderr:Found initrd image: /boot/initrd.img-6.2.0-ceph-g75534f74ac3d 2023-03-03T07:28:14.092 INFO:teuthology.orchestra.run.smithi057.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-03-03T07:28:14.104 INFO:teuthology.orchestra.run.smithi057.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-03-03T07:28:15.829 INFO:teuthology.orchestra.run.smithi057.stderr:done 2023-03-03T07:28:46.977 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-03-03T07:28:46.978 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-03-03T07:28:46.978 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-03T07:29:05.541 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-03-03T07:29:35.569 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-03-03T07:29:35.570 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-03T07:30:35.629 DEBUG:teuthology.orchestra.remote:timed out 2023-03-03T07:31:05.657 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-03-03T07:31:05.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-03T07:31:05.922 DEBUG:teuthology.orchestra.run.smithi057:> true 2023-03-03T07:31:06.770 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-03-03T07:31:06.770 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.2.0-ceph-g75534f74ac3d"... 2023-03-03T07:31:06.771 DEBUG:teuthology.orchestra.run.smithi057:> uname -r 2023-03-03T07:31:06.834 INFO:teuthology.orchestra.run.smithi057.stdout:6.2.0-ceph-g75534f74ac3d 2023-03-03T07:31:06.835 DEBUG:teuthology.task.kernel:current kernel version is 6.2.0-ceph-g75534f74ac3d vs 6.2.0-ceph-g75534f74ac3d 2023-03-03T07:31:06.835 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-03-03T07:31:06.835 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-03-03T07:31:07.836 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-03-03T07:31:07.837 DEBUG:teuthology.orchestra.run.smithi057:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-03-03T07:31:07.955 INFO:teuthology.orchestra.run.smithi057.stdout:ttyS1 2023-03-03T07:31:08.023 DEBUG:teuthology.parallel:result is None 2023-03-03T07:31:08.024 INFO:teuthology.run_tasks:Running task internal.base... 2023-03-03T07:31:08.032 INFO:teuthology.task.internal:Creating test directory... 2023-03-03T07:31:08.033 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-03-03T07:31:08.055 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-03-03T07:31:08.064 INFO:teuthology.run_tasks:Running task internal.archive... 2023-03-03T07:31:08.073 INFO:teuthology.task.internal:Creating archive directory... 2023-03-03T07:31:08.074 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-03-03T07:31:08.130 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-03-03T07:31:08.141 INFO:teuthology.task.internal:Enabling coredump saving... 2023-03-03T07:31:08.142 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-03-03T07:31:08.245 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-03-03T07:31:08.278 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-03-03T07:31:08.286 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-03-03T07:31:08.293 INFO:teuthology.task.internal:Configuring sudo... 2023-03-03T07:31:08.294 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-03-03T07:31:08.339 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-03-03T07:31:08.350 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-03-03T07:31:08.351 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-03-03T07:31:08.408 DEBUG:teuthology.orchestra.run.smithi057:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-03-03T07:31:08.473 DEBUG:teuthology.orchestra.run.smithi057:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-03-03T07:31:08.535 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-03-03T07:31:08.536 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-03-03T07:31:08.631 DEBUG:teuthology.orchestra.run.smithi057:> sudo service rsyslog restart 2023-03-03T07:31:08.864 INFO:teuthology.run_tasks:Running task internal.timer... 2023-03-03T07:31:08.876 INFO:teuthology.task.internal:Starting timer... 2023-03-03T07:31:08.877 INFO:teuthology.run_tasks:Running task pcp... 2023-03-03T07:31:08.891 INFO:teuthology.run_tasks:Running task selinux... 2023-03-03T07:31:08.911 DEBUG:teuthology.task.selinux:Excluding smithi057: OS 'ubuntu' does not support SELinux 2023-03-03T07:31:08.912 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-03-03T07:31:08.912 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-03-03T07:31:08.912 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-03-03T07:31:08.913 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-03-03T07:31:08.923 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-03-03T07:31:08.923 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-03-03T07:31:08.943 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-03-03T07:31:08.945 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi057.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-03-03T07:39:14.464 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi057.front.sepia.ceph.com')] 2023-03-03T07:39:14.466 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-03-03T07:39:14.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-03T07:39:14.575 DEBUG:teuthology.orchestra.run.smithi057:> true 2023-03-03T07:39:14.857 INFO:teuthology.run_tasks:Running task clock... 2023-03-03T07:39:14.875 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-03-03T07:39:14.876 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-03-03T07:39:14.877 DEBUG:teuthology.orchestra.run.smithi057:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-03-03T07:39:15.005 INFO:teuthology.orchestra.run.smithi057.stdout: 3 Mar 07:39:14 ntpd[19932]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-03-03T07:39:15.005 INFO:teuthology.orchestra.run.smithi057.stdout: 3 Mar 07:39:14 ntpd[19932]: Command line: ntpd -gq 2023-03-03T07:39:15.006 INFO:teuthology.orchestra.run.smithi057.stdout: 3 Mar 07:39:15 ntpd[19932]: proto: precision = 0.044 usec (-24) 2023-03-03T07:39:15.007 INFO:teuthology.orchestra.run.smithi057.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-03-03T07:39:15.007 INFO:teuthology.orchestra.run.smithi057.stdout: 3 Mar 07:39:15 ntpd[19932]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-03-03T07:39:15.008 INFO:teuthology.orchestra.run.smithi057.stderr:restrict ::: KOD does nothing without LIMITED. 2023-03-03T07:39:15.009 INFO:teuthology.orchestra.run.smithi057.stdout: 3 Mar 07:39:15 ntpd[19932]: restrict ::: KOD does nothing without LIMITED. 2023-03-03T07:39:15.009 INFO:teuthology.orchestra.run.smithi057.stdout: 3 Mar 07:39:15 ntpd[19932]: Listen and drop on 0 v6wildcard [::]:123 2023-03-03T07:39:15.010 INFO:teuthology.orchestra.run.smithi057.stdout: 3 Mar 07:39:15 ntpd[19932]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-03-03T07:39:15.010 INFO:teuthology.orchestra.run.smithi057.stdout: 3 Mar 07:39:15 ntpd[19932]: Listen normally on 2 lo 127.0.0.1:123 2023-03-03T07:39:15.010 INFO:teuthology.orchestra.run.smithi057.stdout: 3 Mar 07:39:15 ntpd[19932]: Listen normally on 3 ens1f0 172.21.15.57:123 2023-03-03T07:39:15.010 INFO:teuthology.orchestra.run.smithi057.stdout: 3 Mar 07:39:15 ntpd[19932]: Listen normally on 4 lo [::1]:123 2023-03-03T07:39:15.010 INFO:teuthology.orchestra.run.smithi057.stdout: 3 Mar 07:39:15 ntpd[19932]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1562%4]:123 2023-03-03T07:39:15.010 INFO:teuthology.orchestra.run.smithi057.stdout: 3 Mar 07:39:15 ntpd[19932]: Listening on routing socket on fd #22 for interface updates 2023-03-03T07:39:16.006 INFO:teuthology.orchestra.run.smithi057.stderr: 3 Mar 07:39:16 ntpd[19932]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-03-03T07:39:16.007 INFO:teuthology.orchestra.run.smithi057.stderr: 3 Mar 07:39:16 ntpd[19932]: can't open /var/log/ntpstats/rawstats.20230303: Permission denied 2023-03-03T07:39:16.007 INFO:teuthology.orchestra.run.smithi057.stderr: 3 Mar 07:39:16 ntpd[19932]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-03-03T07:39:16.008 INFO:teuthology.orchestra.run.smithi057.stderr: 3 Mar 07:39:16 ntpd[19932]: can't open /var/log/ntpstats/rawstats.20230303: Permission denied 2023-03-03T07:39:16.008 INFO:teuthology.orchestra.run.smithi057.stderr: 3 Mar 07:39:16 ntpd[19932]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-03-03T07:39:16.008 INFO:teuthology.orchestra.run.smithi057.stderr: 3 Mar 07:39:16 ntpd[19932]: can't open /var/log/ntpstats/peerstats.20230303: Permission denied 2023-03-03T07:39:18.006 INFO:teuthology.orchestra.run.smithi057.stderr: 3 Mar 07:39:18 ntpd[19932]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-03-03T07:39:18.006 INFO:teuthology.orchestra.run.smithi057.stderr: 3 Mar 07:39:18 ntpd[19932]: can't open /var/log/ntpstats/rawstats.20230303: Permission denied 2023-03-03T07:39:18.006 INFO:teuthology.orchestra.run.smithi057.stderr: 3 Mar 07:39:18 ntpd[19932]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-03-03T07:39:18.007 INFO:teuthology.orchestra.run.smithi057.stderr: 3 Mar 07:39:18 ntpd[19932]: can't open /var/log/ntpstats/rawstats.20230303: Permission denied 2023-03-03T07:39:18.007 INFO:teuthology.orchestra.run.smithi057.stderr: 3 Mar 07:39:18 ntpd[19932]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-03-03T07:39:18.007 INFO:teuthology.orchestra.run.smithi057.stderr: 3 Mar 07:39:18 ntpd[19932]: can't open /var/log/ntpstats/rawstats.20230303: Permission denied 2023-03-03T07:39:18.008 INFO:teuthology.orchestra.run.smithi057.stderr: 3 Mar 07:39:18 ntpd[19932]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-03-03T07:39:18.008 INFO:teuthology.orchestra.run.smithi057.stderr: 3 Mar 07:39:18 ntpd[19932]: can't open /var/log/ntpstats/rawstats.20230303: Permission denied 2023-03-03T07:39:18.008 INFO:teuthology.orchestra.run.smithi057.stderr: 3 Mar 07:39:18 ntpd[19932]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-03-03T07:39:18.008 INFO:teuthology.orchestra.run.smithi057.stderr: 3 Mar 07:39:18 ntpd[19932]: can't open /var/log/ntpstats/peerstats.20230303: Permission denied 2023-03-03T07:39:18.008 INFO:teuthology.orchestra.run.smithi057.stderr: 3 Mar 07:39:18 ntpd[19932]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-03-03T07:39:18.009 INFO:teuthology.orchestra.run.smithi057.stderr: 3 Mar 07:39:18 ntpd[19932]: can't open /var/log/ntpstats/rawstats.20230303: Permission denied 2023-03-03T07:39:18.009 INFO:teuthology.orchestra.run.smithi057.stderr: 3 Mar 07:39:18 ntpd[19932]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-03-03T07:39:18.009 INFO:teuthology.orchestra.run.smithi057.stderr: 3 Mar 07:39:18 ntpd[19932]: can't open /var/log/ntpstats/peerstats.20230303: Permission denied 2023-03-03T07:39:19.006 INFO:teuthology.orchestra.run.smithi057.stderr: 3 Mar 07:39:19 ntpd[19932]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-03-03T07:39:19.006 INFO:teuthology.orchestra.run.smithi057.stderr: 3 Mar 07:39:19 ntpd[19932]: can't open /var/log/ntpstats/rawstats.20230303: Permission denied 2023-03-03T07:39:19.006 INFO:teuthology.orchestra.run.smithi057.stderr: 3 Mar 07:39:19 ntpd[19932]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-03-03T07:39:19.007 INFO:teuthology.orchestra.run.smithi057.stderr: 3 Mar 07:39:19 ntpd[19932]: can't open /var/log/ntpstats/rawstats.20230303: Permission denied 2023-03-03T07:39:19.007 INFO:teuthology.orchestra.run.smithi057.stderr: 3 Mar 07:39:19 ntpd[19932]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-03-03T07:39:19.007 INFO:teuthology.orchestra.run.smithi057.stderr: 3 Mar 07:39:19 ntpd[19932]: can't open /var/log/ntpstats/peerstats.20230303: Permission denied 2023-03-03T07:39:20.006 INFO:teuthology.orchestra.run.smithi057.stderr: 3 Mar 07:39:20 ntpd[19932]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-03-03T07:39:20.006 INFO:teuthology.orchestra.run.smithi057.stderr: 3 Mar 07:39:20 ntpd[19932]: can't open /var/log/ntpstats/rawstats.20230303: Permission denied 2023-03-03T07:39:20.006 INFO:teuthology.orchestra.run.smithi057.stderr: 3 Mar 07:39:20 ntpd[19932]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-03-03T07:39:20.007 INFO:teuthology.orchestra.run.smithi057.stderr: 3 Mar 07:39:20 ntpd[19932]: can't open /var/log/ntpstats/rawstats.20230303: Permission denied 2023-03-03T07:39:20.008 INFO:teuthology.orchestra.run.smithi057.stderr: 3 Mar 07:39:20 ntpd[19932]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-03-03T07:39:20.008 INFO:teuthology.orchestra.run.smithi057.stderr: 3 Mar 07:39:20 ntpd[19932]: can't open /var/log/ntpstats/rawstats.20230303: Permission denied 2023-03-03T07:39:20.008 INFO:teuthology.orchestra.run.smithi057.stderr: 3 Mar 07:39:20 ntpd[19932]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-03-03T07:39:20.008 INFO:teuthology.orchestra.run.smithi057.stderr: 3 Mar 07:39:20 ntpd[19932]: can't open /var/log/ntpstats/peerstats.20230303: Permission denied 2023-03-03T07:39:20.008 INFO:teuthology.orchestra.run.smithi057.stderr: 3 Mar 07:39:20 ntpd[19932]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-03-03T07:39:20.008 INFO:teuthology.orchestra.run.smithi057.stderr: 3 Mar 07:39:20 ntpd[19932]: can't open /var/log/ntpstats/rawstats.20230303: Permission denied 2023-03-03T07:39:20.008 INFO:teuthology.orchestra.run.smithi057.stderr: 3 Mar 07:39:20 ntpd[19932]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-03-03T07:39:20.009 INFO:teuthology.orchestra.run.smithi057.stderr: 3 Mar 07:39:20 ntpd[19932]: can't open /var/log/ntpstats/peerstats.20230303: Permission denied 2023-03-03T07:39:21.006 INFO:teuthology.orchestra.run.smithi057.stderr: 3 Mar 07:39:21 ntpd[19932]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-03-03T07:39:21.006 INFO:teuthology.orchestra.run.smithi057.stderr: 3 Mar 07:39:21 ntpd[19932]: can't open /var/log/ntpstats/rawstats.20230303: Permission denied 2023-03-03T07:39:21.007 INFO:teuthology.orchestra.run.smithi057.stderr: 3 Mar 07:39:21 ntpd[19932]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-03-03T07:39:21.007 INFO:teuthology.orchestra.run.smithi057.stderr: 3 Mar 07:39:21 ntpd[19932]: can't open /var/log/ntpstats/rawstats.20230303: Permission denied 2023-03-03T07:39:21.007 INFO:teuthology.orchestra.run.smithi057.stderr: 3 Mar 07:39:21 ntpd[19932]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-03-03T07:39:21.007 INFO:teuthology.orchestra.run.smithi057.stderr: 3 Mar 07:39:21 ntpd[19932]: can't open /var/log/ntpstats/peerstats.20230303: Permission denied 2023-03-03T07:39:22.006 INFO:teuthology.orchestra.run.smithi057.stderr: 3 Mar 07:39:22 ntpd[19932]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-03-03T07:39:22.006 INFO:teuthology.orchestra.run.smithi057.stderr: 3 Mar 07:39:22 ntpd[19932]: can't open /var/log/ntpstats/rawstats.20230303: Permission denied 2023-03-03T07:39:22.006 INFO:teuthology.orchestra.run.smithi057.stderr: 3 Mar 07:39:22 ntpd[19932]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-03-03T07:39:22.007 INFO:teuthology.orchestra.run.smithi057.stderr: 3 Mar 07:39:22 ntpd[19932]: can't open /var/log/ntpstats/rawstats.20230303: Permission denied 2023-03-03T07:39:22.007 INFO:teuthology.orchestra.run.smithi057.stderr: 3 Mar 07:39:22 ntpd[19932]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-03-03T07:39:22.008 INFO:teuthology.orchestra.run.smithi057.stderr: 3 Mar 07:39:22 ntpd[19932]: can't open /var/log/ntpstats/rawstats.20230303: Permission denied 2023-03-03T07:39:22.008 INFO:teuthology.orchestra.run.smithi057.stderr: 3 Mar 07:39:22 ntpd[19932]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-03-03T07:39:22.008 INFO:teuthology.orchestra.run.smithi057.stderr: 3 Mar 07:39:22 ntpd[19932]: can't open /var/log/ntpstats/peerstats.20230303: Permission denied 2023-03-03T07:39:22.008 INFO:teuthology.orchestra.run.smithi057.stdout: 3 Mar 07:39:22 ntpd[19932]: ntpd: time slew +0.000850 s 2023-03-03T07:39:22.008 INFO:teuthology.orchestra.run.smithi057.stdout:ntpd: time slew +0.000850s 2023-03-03T07:39:22.009 INFO:teuthology.orchestra.run.smithi057.stderr: 3 Mar 07:39:22 ntpd[19932]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-03-03T07:39:22.009 INFO:teuthology.orchestra.run.smithi057.stderr: 3 Mar 07:39:22 ntpd[19932]: can't open /var/log/ntpstats/loopstats.20230303: Permission denied 2023-03-03T07:39:22.175 INFO:teuthology.orchestra.run.smithi057.stdout: remote refid st t when poll reach delay offset jitter 2023-03-03T07:39:22.176 INFO:teuthology.orchestra.run.smithi057.stdout:============================================================================== 2023-03-03T07:39:22.176 INFO:teuthology.orchestra.run.smithi057.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-03-03T07:39:22.176 INFO:teuthology.orchestra.run.smithi057.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-03-03T07:39:22.177 INFO:teuthology.orchestra.run.smithi057.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-03-03T07:39:22.177 INFO:teuthology.orchestra.run.smithi057.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-03-03T07:39:22.179 INFO:teuthology.run_tasks:Running task install... 2023-03-03T07:39:22.194 DEBUG:teuthology.task.install:project ceph 2023-03-03T07:39:22.195 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '472aaef4ec3b3a2c29f73ca67854785a910f1f9b'}} 2023-03-03T07:39:22.195 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '472aaef4ec3b3a2c29f73ca67854785a910f1f9b'} 2023-03-03T07:39:22.195 INFO:teuthology.task.install:Using flavor: default 2023-03-03T07:39:22.201 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-03-03T07:39:22.202 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-03-03T07:39:22.202 DEBUG:teuthology.orchestra.run.smithi057:> sudo apt-key list | grep Ceph 2023-03-03T07:39:22.504 INFO:teuthology.orchestra.run.smithi057.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-03-03T07:39:22.703 INFO:teuthology.orchestra.run.smithi057.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-03-03T07:39:22.703 INFO:teuthology.orchestra.run.smithi057.stdout:uid [ unknown] Ceph.com (release key) 2023-03-03T07:39:22.706 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-03-03T07:39:22.707 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-03-03T07:39:22.707 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=472aaef4ec3b3a2c29f73ca67854785a910f1f9b 2023-03-03T07:39:22.888 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/ubuntu/focal/flavors/default/ 2023-03-03T07:39:22.889 INFO:teuthology.task.install.deb:Package version is 18.0.0-2739-g472aaef4-1focal 2023-03-03T07:39:23.011 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-03-03T07:39:23.012 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-03-03T07:39:23.057 DEBUG:teuthology.orchestra.run.smithi057:> sudo apt-get update 2023-03-03T07:39:23.433 INFO:teuthology.orchestra.run.smithi057.stdout:Ign:1 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/ubuntu/focal/flavors/default focal InRelease 2023-03-03T07:39:23.454 INFO:teuthology.orchestra.run.smithi057.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-03-03T07:39:23.479 INFO:teuthology.orchestra.run.smithi057.stdout:Ign:3 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/ubuntu/focal/flavors/default focal Release.gpg 2023-03-03T07:39:23.500 INFO:teuthology.orchestra.run.smithi057.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/ubuntu/focal/flavors/default focal/main i386 Packages [3,423 B] 2023-03-03T07:39:23.558 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal InRelease 2023-03-03T07:39:23.558 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:6 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-03-03T07:39:23.580 INFO:teuthology.orchestra.run.smithi057.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/ubuntu/focal/flavors/default focal/main amd64 Packages [17.3 kB] 2023-03-03T07:39:23.582 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-03-03T07:39:23.663 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-03-03T07:39:25.537 INFO:teuthology.orchestra.run.smithi057.stdout:Fetched 28.4 kB in 2s (13.9 kB/s) 2023-03-03T07:39:26.870 INFO:teuthology.orchestra.run.smithi057.stdout:Reading package lists... 2023-03-03T07:39:26.933 DEBUG:teuthology.orchestra.run.smithi057:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-2739-g472aaef4-1focal cephadm=18.0.0-2739-g472aaef4-1focal ceph-mds=18.0.0-2739-g472aaef4-1focal ceph-mgr=18.0.0-2739-g472aaef4-1focal ceph-common=18.0.0-2739-g472aaef4-1focal ceph-fuse=18.0.0-2739-g472aaef4-1focal ceph-test=18.0.0-2739-g472aaef4-1focal ceph-volume=18.0.0-2739-g472aaef4-1focal radosgw=18.0.0-2739-g472aaef4-1focal python3-rados=18.0.0-2739-g472aaef4-1focal python3-rgw=18.0.0-2739-g472aaef4-1focal python3-cephfs=18.0.0-2739-g472aaef4-1focal python3-rbd=18.0.0-2739-g472aaef4-1focal libcephfs2=18.0.0-2739-g472aaef4-1focal libcephfs-dev=18.0.0-2739-g472aaef4-1focal librados2=18.0.0-2739-g472aaef4-1focal librbd1=18.0.0-2739-g472aaef4-1focal rbd-fuse=18.0.0-2739-g472aaef4-1focal python3-cephfs=18.0.0-2739-g472aaef4-1focal cephfs-shell=18.0.0-2739-g472aaef4-1focal cephfs-top=18.0.0-2739-g472aaef4-1focal cephfs-mirror=18.0.0-2739-g472aaef4-1focal 2023-03-03T07:39:27.082 INFO:teuthology.orchestra.run.smithi057.stdout:Reading package lists... 2023-03-03T07:39:27.259 INFO:teuthology.orchestra.run.smithi057.stdout:Building dependency tree... 2023-03-03T07:39:27.260 INFO:teuthology.orchestra.run.smithi057.stdout:Reading state information... 2023-03-03T07:39:27.430 INFO:teuthology.orchestra.run.smithi057.stdout:The following packages were automatically installed and are no longer required: 2023-03-03T07:39:27.431 INFO:teuthology.orchestra.run.smithi057.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-03-03T07:39:27.431 INFO:teuthology.orchestra.run.smithi057.stdout:Use 'sudo apt autoremove' to remove them. 2023-03-03T07:39:27.431 INFO:teuthology.orchestra.run.smithi057.stdout:The following additional packages will be installed: 2023-03-03T07:39:27.431 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-03-03T07:39:27.432 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-03-03T07:39:27.432 INFO:teuthology.orchestra.run.smithi057.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-03-03T07:39:27.432 INFO:teuthology.orchestra.run.smithi057.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-03-03T07:39:27.432 INFO:teuthology.orchestra.run.smithi057.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-03-03T07:39:27.433 INFO:teuthology.orchestra.run.smithi057.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-03-03T07:39:27.433 INFO:teuthology.orchestra.run.smithi057.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-03-03T07:39:27.433 INFO:teuthology.orchestra.run.smithi057.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-03-03T07:39:27.433 INFO:teuthology.orchestra.run.smithi057.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-03-03T07:39:27.433 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2023-03-03T07:39:27.433 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2023-03-03T07:39:27.434 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2023-03-03T07:39:27.434 INFO:teuthology.orchestra.run.smithi057.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2023-03-03T07:39:27.434 INFO:teuthology.orchestra.run.smithi057.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2023-03-03T07:39:27.434 INFO:teuthology.orchestra.run.smithi057.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-03-03T07:39:27.434 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2023-03-03T07:39:27.434 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2023-03-03T07:39:27.434 INFO:teuthology.orchestra.run.smithi057.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-03-03T07:39:27.435 INFO:teuthology.orchestra.run.smithi057.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-03-03T07:39:27.435 INFO:teuthology.orchestra.run.smithi057.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-03-03T07:39:27.435 INFO:teuthology.orchestra.run.smithi057.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-03-03T07:39:27.435 INFO:teuthology.orchestra.run.smithi057.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-03-03T07:39:27.435 INFO:teuthology.orchestra.run.smithi057.stdout: qttranslations5-l10n socat xmlstarlet 2023-03-03T07:39:27.435 INFO:teuthology.orchestra.run.smithi057.stdout:Suggested packages: 2023-03-03T07:39:27.436 INFO:teuthology.orchestra.run.smithi057.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-03-03T07:39:27.436 INFO:teuthology.orchestra.run.smithi057.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-03-03T07:39:27.436 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-03-03T07:39:27.436 INFO:teuthology.orchestra.run.smithi057.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-03-03T07:39:27.436 INFO:teuthology.orchestra.run.smithi057.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-03-03T07:39:27.436 INFO:teuthology.orchestra.run.smithi057.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-03-03T07:39:27.437 INFO:teuthology.orchestra.run.smithi057.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-03-03T07:39:27.437 INFO:teuthology.orchestra.run.smithi057.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-03-03T07:39:27.437 INFO:teuthology.orchestra.run.smithi057.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-03-03T07:39:27.437 INFO:teuthology.orchestra.run.smithi057.stdout:Recommended packages: 2023-03-03T07:39:27.437 INFO:teuthology.orchestra.run.smithi057.stdout: btrfs-tools 2023-03-03T07:39:27.681 INFO:teuthology.orchestra.run.smithi057.stdout:The following NEW packages will be installed: 2023-03-03T07:39:27.681 INFO:teuthology.orchestra.run.smithi057.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-03-03T07:39:27.682 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-03-03T07:39:27.682 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-03-03T07:39:27.682 INFO:teuthology.orchestra.run.smithi057.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-03-03T07:39:27.682 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-03-03T07:39:27.682 INFO:teuthology.orchestra.run.smithi057.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-03-03T07:39:27.682 INFO:teuthology.orchestra.run.smithi057.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-03-03T07:39:27.683 INFO:teuthology.orchestra.run.smithi057.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-03-03T07:39:27.683 INFO:teuthology.orchestra.run.smithi057.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-03-03T07:39:27.684 INFO:teuthology.orchestra.run.smithi057.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-03-03T07:39:27.684 INFO:teuthology.orchestra.run.smithi057.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-03-03T07:39:27.684 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2023-03-03T07:39:27.684 INFO:teuthology.orchestra.run.smithi057.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-03-03T07:39:27.684 INFO:teuthology.orchestra.run.smithi057.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-03-03T07:39:27.684 INFO:teuthology.orchestra.run.smithi057.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-03-03T07:39:27.684 INFO:teuthology.orchestra.run.smithi057.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-03-03T07:39:27.685 INFO:teuthology.orchestra.run.smithi057.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-03-03T07:39:27.685 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-03-03T07:39:27.685 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-03-03T07:39:27.685 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-03-03T07:39:27.685 INFO:teuthology.orchestra.run.smithi057.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-03-03T07:39:27.686 INFO:teuthology.orchestra.run.smithi057.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-03-03T07:39:27.686 INFO:teuthology.orchestra.run.smithi057.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-03-03T07:39:27.686 INFO:teuthology.orchestra.run.smithi057.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-03-03T07:39:27.686 INFO:teuthology.orchestra.run.smithi057.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-03-03T07:39:27.686 INFO:teuthology.orchestra.run.smithi057.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-03-03T07:39:27.686 INFO:teuthology.orchestra.run.smithi057.stdout:The following packages will be upgraded: 2023-03-03T07:39:27.687 INFO:teuthology.orchestra.run.smithi057.stdout: librados2 librbd1 2023-03-03T07:39:27.788 INFO:teuthology.orchestra.run.smithi057.stdout:2 upgraded, 116 newly installed, 0 to remove and 152 not upgraded. 2023-03-03T07:39:27.789 INFO:teuthology.orchestra.run.smithi057.stdout:Need to get 207 MB of archives. 2023-03-03T07:39:27.789 INFO:teuthology.orchestra.run.smithi057.stdout:After this operation, 1,025 MB of additional disk space will be used. 2023-03-03T07:39:27.789 INFO:teuthology.orchestra.run.smithi057.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-03-03T07:39:27.809 INFO:teuthology.orchestra.run.smithi057.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-03-03T07:39:27.817 INFO:teuthology.orchestra.run.smithi057.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-03-03T07:39:27.842 INFO:teuthology.orchestra.run.smithi057.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-03-03T07:39:27.871 INFO:teuthology.orchestra.run.smithi057.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-03-03T07:39:27.875 INFO:teuthology.orchestra.run.smithi057.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-03-03T07:39:27.882 INFO:teuthology.orchestra.run.smithi057.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.0.0-2739-g472aaef4-1focal [3,430 kB] 2023-03-03T07:39:27.888 INFO:teuthology.orchestra.run.smithi057.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-03-03T07:39:27.931 INFO:teuthology.orchestra.run.smithi057.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-03-03T07:39:27.935 INFO:teuthology.orchestra.run.smithi057.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-03-03T07:39:27.943 INFO:teuthology.orchestra.run.smithi057.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-03-03T07:39:27.946 INFO:teuthology.orchestra.run.smithi057.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-03-03T07:39:27.981 INFO:teuthology.orchestra.run.smithi057.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-03-03T07:39:28.055 INFO:teuthology.orchestra.run.smithi057.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-03-03T07:39:28.060 INFO:teuthology.orchestra.run.smithi057.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-03-03T07:39:28.095 INFO:teuthology.orchestra.run.smithi057.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-03-03T07:39:28.097 INFO:teuthology.orchestra.run.smithi057.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-03-03T07:39:28.104 INFO:teuthology.orchestra.run.smithi057.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-03-03T07:39:28.104 INFO:teuthology.orchestra.run.smithi057.stdout:Get:19 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.0.0-2739-g472aaef4-1focal [3,983 kB] 2023-03-03T07:39:28.105 INFO:teuthology.orchestra.run.smithi057.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-03-03T07:39:28.105 INFO:teuthology.orchestra.run.smithi057.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-03-03T07:39:28.106 INFO:teuthology.orchestra.run.smithi057.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-03-03T07:39:28.108 INFO:teuthology.orchestra.run.smithi057.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-03-03T07:39:28.108 INFO:teuthology.orchestra.run.smithi057.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-03-03T07:39:28.144 INFO:teuthology.orchestra.run.smithi057.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-03-03T07:39:28.211 INFO:teuthology.orchestra.run.smithi057.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-03-03T07:39:28.217 INFO:teuthology.orchestra.run.smithi057.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-03-03T07:39:28.229 INFO:teuthology.orchestra.run.smithi057.stdout:Get:28 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.0.0-2739-g472aaef4-1focal [721 kB] 2023-03-03T07:39:28.230 INFO:teuthology.orchestra.run.smithi057.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-03-03T07:39:28.245 INFO:teuthology.orchestra.run.smithi057.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-03-03T07:39:28.246 INFO:teuthology.orchestra.run.smithi057.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-03-03T07:39:28.251 INFO:teuthology.orchestra.run.smithi057.stdout:Get:32 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.0.0-2739-g472aaef4-1focal [375 kB] 2023-03-03T07:39:28.262 INFO:teuthology.orchestra.run.smithi057.stdout:Get:33 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.0.0-2739-g472aaef4-1focal [22.4 kB] 2023-03-03T07:39:28.262 INFO:teuthology.orchestra.run.smithi057.stdout:Get:34 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.0.0-2739-g472aaef4-1focal [185 kB] 2023-03-03T07:39:28.269 INFO:teuthology.orchestra.run.smithi057.stdout:Get:35 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.0.0-2739-g472aaef4-1focal [47.7 kB] 2023-03-03T07:39:28.271 INFO:teuthology.orchestra.run.smithi057.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-03-03T07:39:28.271 INFO:teuthology.orchestra.run.smithi057.stdout:Get:37 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.0.0-2739-g472aaef4-1focal [354 kB] 2023-03-03T07:39:28.271 INFO:teuthology.orchestra.run.smithi057.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-03-03T07:39:28.272 INFO:teuthology.orchestra.run.smithi057.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-03-03T07:39:28.273 INFO:teuthology.orchestra.run.smithi057.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-03-03T07:39:28.275 INFO:teuthology.orchestra.run.smithi057.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2023-03-03T07:39:28.282 INFO:teuthology.orchestra.run.smithi057.stdout:Get:42 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.0.0-2739-g472aaef4-1focal [6,520 kB] 2023-03-03T07:39:28.314 INFO:teuthology.orchestra.run.smithi057.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-03-03T07:39:28.406 INFO:teuthology.orchestra.run.smithi057.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-03-03T07:39:28.409 INFO:teuthology.orchestra.run.smithi057.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2023-03-03T07:39:28.418 INFO:teuthology.orchestra.run.smithi057.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-03-03T07:39:28.427 INFO:teuthology.orchestra.run.smithi057.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-03-03T07:39:28.428 INFO:teuthology.orchestra.run.smithi057.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-03-03T07:39:28.430 INFO:teuthology.orchestra.run.smithi057.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-03-03T07:39:28.431 INFO:teuthology.orchestra.run.smithi057.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-03-03T07:39:28.434 INFO:teuthology.orchestra.run.smithi057.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-03-03T07:39:28.436 INFO:teuthology.orchestra.run.smithi057.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-03-03T07:39:28.436 INFO:teuthology.orchestra.run.smithi057.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-03-03T07:39:28.479 INFO:teuthology.orchestra.run.smithi057.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-03-03T07:39:28.501 INFO:teuthology.orchestra.run.smithi057.stdout:Get:55 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.0.0-2739-g472aaef4-1focal [103 kB] 2023-03-03T07:39:28.503 INFO:teuthology.orchestra.run.smithi057.stdout:Get:56 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.0.0-2739-g472aaef4-1focal [467 kB] 2023-03-03T07:39:28.515 INFO:teuthology.orchestra.run.smithi057.stdout:Get:57 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.0.0-2739-g472aaef4-1focal [25.0 MB] 2023-03-03T07:39:28.559 INFO:teuthology.orchestra.run.smithi057.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-03-03T07:39:28.560 INFO:teuthology.orchestra.run.smithi057.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-03-03T07:39:28.567 INFO:teuthology.orchestra.run.smithi057.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-03-03T07:39:28.576 INFO:teuthology.orchestra.run.smithi057.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-03-03T07:39:28.583 INFO:teuthology.orchestra.run.smithi057.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-03-03T07:39:28.583 INFO:teuthology.orchestra.run.smithi057.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-03-03T07:39:28.586 INFO:teuthology.orchestra.run.smithi057.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-03-03T07:39:28.724 INFO:teuthology.orchestra.run.smithi057.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-03-03T07:39:28.747 INFO:teuthology.orchestra.run.smithi057.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-03-03T07:39:28.749 INFO:teuthology.orchestra.run.smithi057.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-03-03T07:39:28.803 INFO:teuthology.orchestra.run.smithi057.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-03-03T07:39:28.823 INFO:teuthology.orchestra.run.smithi057.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-03-03T07:39:28.849 INFO:teuthology.orchestra.run.smithi057.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-03-03T07:39:28.860 INFO:teuthology.orchestra.run.smithi057.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-03-03T07:39:28.866 INFO:teuthology.orchestra.run.smithi057.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-03-03T07:39:28.873 INFO:teuthology.orchestra.run.smithi057.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-03-03T07:39:28.876 INFO:teuthology.orchestra.run.smithi057.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-03-03T07:39:28.886 INFO:teuthology.orchestra.run.smithi057.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-03-03T07:39:28.888 INFO:teuthology.orchestra.run.smithi057.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-03-03T07:39:28.891 INFO:teuthology.orchestra.run.smithi057.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-03-03T07:39:28.908 INFO:teuthology.orchestra.run.smithi057.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-03-03T07:39:28.949 INFO:teuthology.orchestra.run.smithi057.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-03-03T07:39:29.026 INFO:teuthology.orchestra.run.smithi057.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-03-03T07:39:29.031 INFO:teuthology.orchestra.run.smithi057.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-03-03T07:39:29.064 INFO:teuthology.orchestra.run.smithi057.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-03-03T07:39:29.075 INFO:teuthology.orchestra.run.smithi057.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-03-03T07:39:29.075 INFO:teuthology.orchestra.run.smithi057.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-03-03T07:39:29.115 INFO:teuthology.orchestra.run.smithi057.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-03-03T07:39:29.119 INFO:teuthology.orchestra.run.smithi057.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2023-03-03T07:39:29.123 INFO:teuthology.orchestra.run.smithi057.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-03-03T07:39:29.188 INFO:teuthology.orchestra.run.smithi057.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-03-03T07:39:29.189 INFO:teuthology.orchestra.run.smithi057.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-03-03T07:39:29.225 INFO:teuthology.orchestra.run.smithi057.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-03-03T07:39:29.292 INFO:teuthology.orchestra.run.smithi057.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-03-03T07:39:29.349 INFO:teuthology.orchestra.run.smithi057.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.0.0-2739-g472aaef4-1focal [11.0 MB] 2023-03-03T07:39:29.370 INFO:teuthology.orchestra.run.smithi057.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-03-03T07:39:29.370 INFO:teuthology.orchestra.run.smithi057.stdout:Get:94 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-03-03T07:39:29.372 INFO:teuthology.orchestra.run.smithi057.stdout:Get:95 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-03-03T07:39:29.373 INFO:teuthology.orchestra.run.smithi057.stdout:Get:96 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-03-03T07:39:29.373 INFO:teuthology.orchestra.run.smithi057.stdout:Get:97 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-03-03T07:39:29.710 INFO:teuthology.orchestra.run.smithi057.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.0.0-2739-g472aaef4-1focal [221 kB] 2023-03-03T07:39:29.713 INFO:teuthology.orchestra.run.smithi057.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.0.0-2739-g472aaef4-1focal [133 kB] 2023-03-03T07:39:29.715 INFO:teuthology.orchestra.run.smithi057.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.0.0-2739-g472aaef4-1focal [1,546 kB] 2023-03-03T07:39:29.765 INFO:teuthology.orchestra.run.smithi057.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.0.0-2739-g472aaef4-1focal [9,378 kB] 2023-03-03T07:39:30.078 INFO:teuthology.orchestra.run.smithi057.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.0.0-2739-g472aaef4-1focal [31.3 MB] 2023-03-03T07:39:31.116 INFO:teuthology.orchestra.run.smithi057.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.0.0-2739-g472aaef4-1focal [3,816 B] 2023-03-03T07:39:31.118 INFO:teuthology.orchestra.run.smithi057.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.0.0-2739-g472aaef4-1focal [829 kB] 2023-03-03T07:39:31.127 INFO:teuthology.orchestra.run.smithi057.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.0.0-2739-g472aaef4-1focal [2,286 kB] 2023-03-03T07:39:31.277 INFO:teuthology.orchestra.run.smithi057.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.0.0-2739-g472aaef4-1focal [96.8 kB] 2023-03-03T07:39:31.279 INFO:teuthology.orchestra.run.smithi057.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.0.0-2739-g472aaef4-1focal [117 kB] 2023-03-03T07:39:31.282 INFO:teuthology.orchestra.run.smithi057.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.0.0-2739-g472aaef4-1focal [1,795 kB] 2023-03-03T07:39:31.307 INFO:teuthology.orchestra.run.smithi057.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.0.0-2739-g472aaef4-1focal [7,888 kB] 2023-03-03T07:39:31.530 INFO:teuthology.orchestra.run.smithi057.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.0.0-2739-g472aaef4-1focal [3,936 B] 2023-03-03T07:39:31.531 INFO:teuthology.orchestra.run.smithi057.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.0.0-2739-g472aaef4-1focal [49.8 MB] 2023-03-03T07:39:33.188 INFO:teuthology.orchestra.run.smithi057.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.0.0-2739-g472aaef4-1focal [225 kB] 2023-03-03T07:39:33.190 INFO:teuthology.orchestra.run.smithi057.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.0.0-2739-g472aaef4-1focal [253 kB] 2023-03-03T07:39:33.193 INFO:teuthology.orchestra.run.smithi057.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.0.0-2739-g472aaef4-1focal [23.3 kB] 2023-03-03T07:39:33.194 INFO:teuthology.orchestra.run.smithi057.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.0.0-2739-g472aaef4-1focal [13.0 kB] 2023-03-03T07:39:33.195 INFO:teuthology.orchestra.run.smithi057.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.0.0-2739-g472aaef4-1focal [27.4 kB] 2023-03-03T07:39:33.195 INFO:teuthology.orchestra.run.smithi057.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.0.0-2739-g472aaef4-1focal [13.3 MB] 2023-03-03T07:39:33.621 INFO:teuthology.orchestra.run.smithi057.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.0.0-2739-g472aaef4-1focal [97.2 kB] 2023-03-03T07:39:34.755 INFO:teuthology.orchestra.run.smithi057.stdout:Fetched 207 MB in 6s (34.9 MB/s) 2023-03-03T07:39:34.947 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pyperclip. 2023-03-03T07:39:35.031 INFO:teuthology.orchestra.run.smithi057.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 107774 files and directories currently installed.) 2023-03-03T07:39:35.035 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-03-03T07:39:35.084 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-03-03T07:39:35.454 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-wcwidth. 2023-03-03T07:39:35.474 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-03-03T07:39:35.512 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-03-03T07:39:35.890 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-cmd2. 2023-03-03T07:39:35.912 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-03-03T07:39:35.957 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-03-03T07:39:36.343 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-03-03T07:39:36.363 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-03-03T07:39:36.444 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-03-03T07:39:36.881 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-03-03T07:39:36.901 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-03-03T07:39:36.939 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-03-03T07:39:37.326 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-03-03T07:39:37.346 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-03-03T07:39:37.384 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-03-03T07:39:37.912 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-03-03T07:39:37.931 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-03-03T07:39:38.004 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-03-03T07:39:38.541 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-03-03T07:39:38.560 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-03-03T07:39:38.599 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-03-03T07:39:39.011 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-03-03T07:39:39.031 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-03-03T07:39:39.068 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-03-03T07:39:39.539 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-03-03T07:39:39.559 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-03-03T07:39:39.597 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-03-03T07:39:40.004 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../010-librbd1_18.0.0-2739-g472aaef4-1focal_amd64.deb ... 2023-03-03T07:39:40.134 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking librbd1 (18.0.0-2739-g472aaef4-1focal) over (15.2.17-0ubuntu0.20.04.1) ... 2023-03-03T07:39:40.892 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../011-librados2_18.0.0-2739-g472aaef4-1focal_amd64.deb ... 2023-03-03T07:39:41.164 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking librados2 (18.0.0-2739-g472aaef4-1focal) over (15.2.17-0ubuntu0.20.04.1) ... 2023-03-03T07:39:41.952 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libcephfs2. 2023-03-03T07:39:41.973 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-2739-g472aaef4-1focal_amd64.deb ... 2023-03-03T07:39:42.018 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libcephfs2 (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:39:42.413 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-rados. 2023-03-03T07:39:42.433 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../013-python3-rados_18.0.0-2739-g472aaef4-1focal_amd64.deb ... 2023-03-03T07:39:42.471 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-rados (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:39:42.865 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-03-03T07:39:42.886 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-2739-g472aaef4-1focal_all.deb ... 2023-03-03T07:39:42.932 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-ceph-argparse (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:39:43.251 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-cephfs. 2023-03-03T07:39:43.272 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-2739-g472aaef4-1focal_amd64.deb ... 2023-03-03T07:39:43.309 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-cephfs (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:39:43.688 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-ceph-common. 2023-03-03T07:39:43.708 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-2739-g472aaef4-1focal_all.deb ... 2023-03-03T07:39:43.745 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-ceph-common (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:39:44.158 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-prettytable. 2023-03-03T07:39:44.178 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2023-03-03T07:39:44.224 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-03-03T07:39:44.528 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-rbd. 2023-03-03T07:39:44.547 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-2739-g472aaef4-1focal_amd64.deb ... 2023-03-03T07:39:44.585 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-rbd (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:39:45.013 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-03-03T07:39:45.034 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-03-03T07:39:45.079 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-03-03T07:39:45.550 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-03-03T07:39:45.571 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2023-03-03T07:39:45.608 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-03-03T07:39:46.009 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-03-03T07:39:46.027 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-03-03T07:39:46.067 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-03-03T07:39:46.695 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package librgw2. 2023-03-03T07:39:46.716 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../022-librgw2_18.0.0-2739-g472aaef4-1focal_amd64.deb ... 2023-03-03T07:39:46.753 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking librgw2 (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:39:47.706 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-rgw. 2023-03-03T07:39:47.727 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../023-python3-rgw_18.0.0-2739-g472aaef4-1focal_amd64.deb ... 2023-03-03T07:39:47.764 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-rgw (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:39:48.167 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package liboath0. 2023-03-03T07:39:48.188 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-03-03T07:39:48.234 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-03-03T07:39:48.597 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libradosstriper1. 2023-03-03T07:39:48.616 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../025-libradosstriper1_18.0.0-2739-g472aaef4-1focal_amd64.deb ... 2023-03-03T07:39:48.655 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libradosstriper1 (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:39:49.166 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-common. 2023-03-03T07:39:49.181 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../026-ceph-common_18.0.0-2739-g472aaef4-1focal_amd64.deb ... 2023-03-03T07:39:49.225 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-common (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:39:51.934 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-base. 2023-03-03T07:39:51.953 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../027-ceph-base_18.0.0-2739-g472aaef4-1focal_amd64.deb ... 2023-03-03T07:39:52.033 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-base (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:39:53.606 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-cherrypy3. 2023-03-03T07:39:53.624 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2023-03-03T07:39:53.664 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-03-03T07:39:54.143 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-natsort. 2023-03-03T07:39:54.163 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2023-03-03T07:39:54.201 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-03-03T07:39:54.596 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-logutils. 2023-03-03T07:39:54.616 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2023-03-03T07:39:54.654 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-03-03T07:39:54.999 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-markupsafe. 2023-03-03T07:39:55.018 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-03-03T07:39:55.057 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-03-03T07:39:55.419 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-mako. 2023-03-03T07:39:55.439 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-03-03T07:39:55.476 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-03-03T07:39:55.873 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-simplegeneric. 2023-03-03T07:39:55.893 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2023-03-03T07:39:55.938 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-03-03T07:39:56.283 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-singledispatch. 2023-03-03T07:39:56.303 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-03-03T07:39:56.362 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-03-03T07:39:56.711 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-webob. 2023-03-03T07:39:56.731 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2_all.deb ... 2023-03-03T07:39:56.769 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-03-03T07:39:57.190 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-soupsieve. 2023-03-03T07:39:57.210 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-03-03T07:39:57.256 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-03-03T07:39:57.667 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-bs4. 2023-03-03T07:39:57.687 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2023-03-03T07:39:57.725 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-03-03T07:39:58.162 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-waitress. 2023-03-03T07:39:58.185 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-03-03T07:39:58.251 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-03-03T07:39:58.659 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-tempita. 2023-03-03T07:39:58.680 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2023-03-03T07:39:58.712 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-03-03T07:39:59.072 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-paste. 2023-03-03T07:39:59.092 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-03-03T07:39:59.129 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-03-03T07:39:59.519 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-03-03T07:39:59.540 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-03-03T07:39:59.588 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-03-03T07:39:59.959 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pastedeploy. 2023-03-03T07:39:59.980 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2023-03-03T07:40:00.017 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-03-03T07:40:00.379 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-webtest. 2023-03-03T07:40:00.399 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2023-03-03T07:40:00.445 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-03-03T07:40:00.824 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pecan. 2023-03-03T07:40:00.844 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-03-03T07:40:00.881 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-03-03T07:40:01.354 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-werkzeug. 2023-03-03T07:40:01.373 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2023-03-03T07:40:01.411 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2023-03-03T07:40:02.382 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-03-03T07:40:02.403 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.0.0-2739-g472aaef4-1focal_all.deb ... 2023-03-03T07:40:02.448 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mgr-modules-core (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:40:02.946 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-03-03T07:40:02.967 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.0.0-2739-g472aaef4-1focal_amd64.deb ... 2023-03-03T07:40:03.012 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:40:03.407 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-cryptography. 2023-03-03T07:40:03.428 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../048-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-03-03T07:40:03.465 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-03-03T07:40:03.903 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-openssl. 2023-03-03T07:40:03.923 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../049-python3-openssl_19.0.0-1build1_all.deb ... 2023-03-03T07:40:03.961 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-03-03T07:40:04.381 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mgr. 2023-03-03T07:40:04.402 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../050-ceph-mgr_18.0.0-2739-g472aaef4-1focal_amd64.deb ... 2023-03-03T07:40:04.439 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mgr (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:40:04.976 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mon. 2023-03-03T07:40:04.997 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../051-ceph-mon_18.0.0-2739-g472aaef4-1focal_amd64.deb ... 2023-03-03T07:40:05.042 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mon (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:40:06.356 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-osd. 2023-03-03T07:40:06.376 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../052-ceph-osd_18.0.0-2739-g472aaef4-1focal_amd64.deb ... 2023-03-03T07:40:06.413 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-osd (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:40:09.275 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph. 2023-03-03T07:40:09.296 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../053-ceph_18.0.0-2739-g472aaef4-1focal_amd64.deb ... 2023-03-03T07:40:09.325 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:40:09.836 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-fuse. 2023-03-03T07:40:09.857 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../054-ceph-fuse_18.0.0-2739-g472aaef4-1focal_amd64.deb ... 2023-03-03T07:40:09.894 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-fuse (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:40:10.367 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mds. 2023-03-03T07:40:10.387 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../055-ceph-mds_18.0.0-2739-g472aaef4-1focal_amd64.deb ... 2023-03-03T07:40:10.424 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mds (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:40:11.011 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package cephadm. 2023-03-03T07:40:11.031 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../056-cephadm_18.0.0-2739-g472aaef4-1focal_amd64.deb ... 2023-03-03T07:40:11.068 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking cephadm (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:40:11.446 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-asyncssh. 2023-03-03T07:40:11.467 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../057-python3-asyncssh_1.12.2-1_all.deb ... 2023-03-03T07:40:11.504 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2023-03-03T07:40:11.958 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-jinja2. 2023-03-03T07:40:11.978 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../058-python3-jinja2_2.10.1-2_all.deb ... 2023-03-03T07:40:12.023 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-03-03T07:40:12.560 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-03-03T07:40:12.580 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../059-ceph-mgr-cephadm_18.0.0-2739-g472aaef4-1focal_all.deb ... 2023-03-03T07:40:12.617 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mgr-cephadm (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:40:13.021 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-bcrypt. 2023-03-03T07:40:13.035 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../060-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-03-03T07:40:13.079 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-03-03T07:40:13.441 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-jwt. 2023-03-03T07:40:13.461 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-03-03T07:40:13.498 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-03-03T07:40:13.885 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-attr. 2023-03-03T07:40:13.904 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../062-python3-attr_19.3.0-2_all.deb ... 2023-03-03T07:40:13.943 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-03-03T07:40:14.404 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pluggy. 2023-03-03T07:40:14.425 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../063-python3-pluggy_0.13.0-2_all.deb ... 2023-03-03T07:40:14.462 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-03-03T07:40:14.857 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-py. 2023-03-03T07:40:14.876 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../064-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-03-03T07:40:14.915 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-03-03T07:40:15.451 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-atomicwrites. 2023-03-03T07:40:15.472 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../065-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-03-03T07:40:15.517 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-03-03T07:40:15.895 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-packaging. 2023-03-03T07:40:15.916 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../066-python3-packaging_20.3-1_all.deb ... 2023-03-03T07:40:15.961 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-packaging (20.3-1) ... 2023-03-03T07:40:16.331 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pytest. 2023-03-03T07:40:16.352 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../067-python3-pytest_4.6.9-1_all.deb ... 2023-03-03T07:40:16.389 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-03-03T07:40:16.784 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-repoze.lru. 2023-03-03T07:40:16.805 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../068-python3-repoze.lru_0.7-2_all.deb ... 2023-03-03T07:40:16.850 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-03-03T07:40:17.329 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libjs-underscore. 2023-03-03T07:40:17.348 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../069-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-03-03T07:40:17.386 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-03-03T07:40:17.722 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-03-03T07:40:17.742 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../070-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-03-03T07:40:17.788 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-03-03T07:40:18.149 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-routes. 2023-03-03T07:40:18.169 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../071-python3-routes_2.4.1-2_all.deb ... 2023-03-03T07:40:18.207 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-03-03T07:40:18.627 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-03-03T07:40:18.647 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_18.0.0-2739-g472aaef4-1focal_all.deb ... 2023-03-03T07:40:18.693 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mgr-dashboard (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:40:19.305 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-decorator. 2023-03-03T07:40:19.326 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../073-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-03-03T07:40:19.371 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-03-03T07:40:19.732 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-03-03T07:40:19.752 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../074-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-03-03T07:40:19.790 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-03-03T07:40:20.268 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-scipy. 2023-03-03T07:40:20.288 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../075-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-03-03T07:40:20.325 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-03-03T07:40:21.834 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-03-03T07:40:21.855 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../076-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-03-03T07:40:21.900 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-03-03T07:40:22.487 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-joblib. 2023-03-03T07:40:22.508 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../077-python3-joblib_0.14.0-3_all.deb ... 2023-03-03T07:40:22.554 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-03-03T07:40:23.031 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-sklearn. 2023-03-03T07:40:23.045 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../078-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-03-03T07:40:23.098 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-03-03T07:40:23.948 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-03-03T07:40:23.968 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../079-ceph-mgr-diskprediction-local_18.0.0-2739-g472aaef4-1focal_all.deb ... 2023-03-03T07:40:24.022 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:40:25.450 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-cachetools. 2023-03-03T07:40:25.471 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../080-python3-cachetools_4.0.0-1_all.deb ... 2023-03-03T07:40:25.516 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-03-03T07:40:25.979 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pyasn1. 2023-03-03T07:40:26.000 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../081-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-03-03T07:40:26.046 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-03-03T07:40:26.483 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-03-03T07:40:26.504 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../082-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-03-03T07:40:26.549 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-03-03T07:40:27.020 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-rsa. 2023-03-03T07:40:27.040 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../083-python3-rsa_4.0-3_all.deb ... 2023-03-03T07:40:27.085 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-rsa (4.0-3) ... 2023-03-03T07:40:27.472 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-google-auth. 2023-03-03T07:40:27.493 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../084-python3-google-auth_1.5.1-2_all.deb ... 2023-03-03T07:40:27.538 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-03-03T07:40:27.967 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-blinker. 2023-03-03T07:40:27.989 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../085-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-03-03T07:40:28.033 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-03-03T07:40:28.519 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-oauthlib. 2023-03-03T07:40:28.533 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../086-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-03-03T07:40:28.577 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-03-03T07:40:28.980 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-03-03T07:40:28.995 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../087-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-03-03T07:40:29.039 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-03-03T07:40:29.425 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-websocket. 2023-03-03T07:40:29.440 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../088-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-03-03T07:40:29.483 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-03-03T07:40:29.911 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-kubernetes. 2023-03-03T07:40:29.932 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../089-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-03-03T07:40:29.977 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-03-03T07:40:30.833 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-03-03T07:40:30.853 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../090-ceph-mgr-k8sevents_18.0.0-2739-g472aaef4-1focal_all.deb ... 2023-03-03T07:40:30.898 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:40:31.276 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libonig5:amd64. 2023-03-03T07:40:31.291 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../091-libonig5_6.9.4-1_amd64.deb ... 2023-03-03T07:40:31.326 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-03-03T07:40:31.729 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libjq1:amd64. 2023-03-03T07:40:31.750 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../092-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-03-03T07:40:31.795 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-03-03T07:40:32.131 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package jq. 2023-03-03T07:40:32.152 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../093-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-03-03T07:40:32.197 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-03-03T07:40:32.559 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package socat. 2023-03-03T07:40:32.581 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../094-socat_1.7.3.3-2_amd64.deb ... 2023-03-03T07:40:32.625 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking socat (1.7.3.3-2) ... 2023-03-03T07:40:32.987 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package xmlstarlet. 2023-03-03T07:40:33.007 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../095-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-03-03T07:40:33.053 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-03-03T07:40:33.541 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-test. 2023-03-03T07:40:33.562 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../096-ceph-test_18.0.0-2739-g472aaef4-1focal_amd64.deb ... 2023-03-03T07:40:33.607 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-test (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:40:38.069 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-volume. 2023-03-03T07:40:38.090 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../097-ceph-volume_18.0.0-2739-g472aaef4-1focal_all.deb ... 2023-03-03T07:40:38.135 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-volume (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:40:38.565 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package cephfs-mirror. 2023-03-03T07:40:38.586 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../098-cephfs-mirror_18.0.0-2739-g472aaef4-1focal_amd64.deb ... 2023-03-03T07:40:38.630 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking cephfs-mirror (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:40:39.025 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-colorama. 2023-03-03T07:40:39.046 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../099-python3-colorama_0.4.3-1build1_all.deb ... 2023-03-03T07:40:39.091 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-03-03T07:40:39.436 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package cephfs-shell. 2023-03-03T07:40:39.457 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../100-cephfs-shell_18.0.0-2739-g472aaef4-1focal_all.deb ... 2023-03-03T07:40:39.502 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking cephfs-shell (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:40:39.821 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package cephfs-top. 2023-03-03T07:40:39.842 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../101-cephfs-top_18.0.0-2739-g472aaef4-1focal_all.deb ... 2023-03-03T07:40:39.887 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking cephfs-top (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:40:40.190 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package fonts-mathjax. 2023-03-03T07:40:40.205 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../102-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-03-03T07:40:40.248 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-03-03T07:40:40.819 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libcephfs-dev. 2023-03-03T07:40:40.838 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../103-libcephfs-dev_18.0.0-2739-g472aaef4-1focal_amd64.deb ... 2023-03-03T07:40:40.876 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libcephfs-dev (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:40:41.355 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package nvme-cli. 2023-03-03T07:40:41.376 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../104-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-03-03T07:40:41.477 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-03-03T07:40:41.909 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-03-03T07:40:41.929 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../105-python-asyncssh-doc_1.12.2-1_all.deb ... 2023-03-03T07:40:41.966 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2023-03-03T07:40:42.403 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libjs-mathjax. 2023-03-03T07:40:42.424 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../106-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-03-03T07:40:42.469 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-03-03T07:40:44.835 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-natsort-doc. 2023-03-03T07:40:44.858 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../107-python-natsort-doc_7.0.1-1_all.deb ... 2023-03-03T07:40:44.901 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-03-03T07:40:45.346 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-webencodings. 2023-03-03T07:40:45.368 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../108-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-03-03T07:40:45.412 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-03-03T07:40:45.782 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-html5lib. 2023-03-03T07:40:45.804 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../109-python3-html5lib_1.0.1-2_all.deb ... 2023-03-03T07:40:45.849 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-03-03T07:40:46.227 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-03-03T07:40:46.249 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../110-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-03-03T07:40:46.293 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-03-03T07:40:46.796 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pastescript. 2023-03-03T07:40:46.819 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../111-python3-pastescript_2.0.2-4_all.deb ... 2023-03-03T07:40:46.862 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-03-03T07:40:47.249 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-psutil. 2023-03-03T07:40:47.271 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../112-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-03-03T07:40:47.315 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-03-03T07:40:47.702 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pyinotify. 2023-03-03T07:40:47.722 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../113-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-03-03T07:40:47.759 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-03-03T07:40:48.462 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-simplejson. 2023-03-03T07:40:48.484 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-03-03T07:40:48.528 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-03-03T07:40:48.873 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-03-03T07:40:48.894 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-03-03T07:40:48.939 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-03-03T07:40:49.710 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package radosgw. 2023-03-03T07:40:49.733 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../116-radosgw_18.0.0-2739-g472aaef4-1focal_amd64.deb ... 2023-03-03T07:40:49.775 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking radosgw (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:40:51.337 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package rbd-fuse. 2023-03-03T07:40:51.358 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../117-rbd-fuse_18.0.0-2739-g472aaef4-1focal_amd64.deb ... 2023-03-03T07:40:51.403 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking rbd-fuse (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:40:51.801 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-attr (19.3.0-2) ... 2023-03-03T07:40:52.251 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-03-03T07:40:52.375 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-03-03T07:40:52.501 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-03-03T07:40:52.753 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up cephadm (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:40:53.518 INFO:teuthology.orchestra.run.smithi057.stdout:Adding system user cephadm....done 2023-03-03T07:40:53.718 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-03-03T07:40:53.844 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-03-03T07:40:54.312 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-03-03T07:40:54.722 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-03-03T07:40:54.848 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-03-03T07:40:54.974 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-03-03T07:40:55.425 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-03-03T07:40:55.994 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-03-03T07:40:56.395 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-03-03T07:40:56.796 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-03-03T07:40:57.214 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-03-03T07:40:57.615 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-03-03T07:40:58.024 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-ceph-argparse (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:40:58.442 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-03-03T07:40:58.568 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-03-03T07:40:58.977 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-03-03T07:40:59.403 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-03-03T07:40:59.813 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-03-03T07:40:59.938 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-03-03T07:41:00.448 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-03-03T07:41:00.882 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-03-03T07:41:01.275 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-03-03T07:41:01.742 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-03-03T07:41:02.144 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-03-03T07:41:02.603 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-03-03T07:41:03.037 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-packaging (20.3-1) ... 2023-03-03T07:41:03.455 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-03-03T07:41:03.581 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-03-03T07:41:03.707 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-03-03T07:41:04.099 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-03-03T07:41:04.651 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-03-03T07:41:05.069 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2023-03-03T07:41:05.571 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-03-03T07:41:06.072 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up socat (1.7.3.3-2) ... 2023-03-03T07:41:06.198 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-ceph-common (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:41:06.666 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-03-03T07:41:06.825 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-03-03T07:41:07.319 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-03-03T07:41:07.444 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-03-03T07:41:07.570 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-03-03T07:41:07.972 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-03-03T07:41:08.398 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-03-03T07:41:08.524 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-03-03T07:41:08.650 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-03-03T07:41:09.110 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-03-03T07:41:09.503 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-03-03T07:41:09.912 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-03-03T07:41:10.038 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-03-03T07:41:10.451 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-03-03T07:41:10.870 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-03-03T07:41:11.294 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-03-03T07:41:11.721 INFO:teuthology.orchestra.run.smithi057.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-03-03T07:41:12.080 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-03-03T07:41:12.206 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-03-03T07:41:12.657 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-03-03T07:41:13.150 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-03-03T07:41:13.276 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-03-03T07:41:13.427 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-03-03T07:41:13.886 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-03-03T07:41:14.287 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-03-03T07:41:16.377 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-03-03T07:41:16.503 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-03-03T07:41:17.040 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-03-03T07:41:17.441 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-03-03T07:41:17.843 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-03-03T07:41:17.977 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-03-03T07:41:18.428 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-03-03T07:41:18.888 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2023-03-03T07:41:19.414 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-03-03T07:41:19.884 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-03-03T07:41:21.299 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-03-03T07:41:21.423 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-03-03T07:41:21.549 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-03-03T07:41:21.674 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-rsa (4.0-3) ... 2023-03-03T07:41:22.092 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-03-03T07:41:22.228 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-03-03T07:41:22.645 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-03-03T07:41:23.054 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-03-03T07:41:23.500 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-03-03T07:41:23.999 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up librados2 (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:41:24.252 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2023-03-03T07:41:24.378 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up librgw2 (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:41:24.520 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libsqlite3-mod-ceph (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:41:24.646 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libcephfs2 (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:41:24.772 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-routes (2.4.1-2) ... 2023-03-03T07:41:25.182 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libradosstriper1 (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:41:25.308 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-03-03T07:41:25.736 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up librbd1 (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:41:25.863 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mgr-modules-core (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:41:25.989 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-fuse (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:41:26.280 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-03-03T07:41:26.280 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-03-03T07:41:27.365 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libcephfs-dev (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:41:27.491 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-rados (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:41:27.617 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up cephfs-top (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:41:27.760 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-03-03T07:41:29.059 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-rbd (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:41:29.194 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up rbd-fuse (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:41:29.319 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-rgw (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:41:29.454 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-cephfs (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:41:29.579 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up cephfs-shell (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:41:29.707 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-common (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:41:30.296 INFO:teuthology.orchestra.run.smithi057.stdout:Adding group ceph....done 2023-03-03T07:41:30.780 INFO:teuthology.orchestra.run.smithi057.stdout:Adding system user ceph....done 2023-03-03T07:41:31.031 INFO:teuthology.orchestra.run.smithi057.stdout:Setting system user ceph properties....done 2023-03-03T07:41:31.072 INFO:teuthology.orchestra.run.smithi057.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-03-03T07:41:31.301 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-03-03T07:41:31.950 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-03-03T07:41:33.116 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up cephfs-mirror (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:41:33.242 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-test (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:41:33.368 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up radosgw (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:41:33.714 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-03-03T07:41:33.714 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-03-03T07:41:35.261 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-base (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:41:35.845 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-03-03T07:41:36.938 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mds (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:41:37.236 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-03-03T07:41:37.236 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-03-03T07:41:38.306 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mgr (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:41:38.586 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-03-03T07:41:38.587 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-03-03T07:41:39.633 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-osd (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:41:40.600 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-03-03T07:41:40.600 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-03-03T07:41:41.659 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mgr-k8sevents (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:41:41.785 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:41:41.944 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mon (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:41:42.222 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-03-03T07:41:42.223 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-03-03T07:41:43.270 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mgr-cephadm (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:41:43.430 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:41:43.564 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mgr-dashboard (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:41:43.723 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-volume (18.0.0-2739-g472aaef4-1focal) ... 2023-03-03T07:41:43.850 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-03-03T07:41:44.029 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-03-03T07:41:44.597 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-03-03T07:41:51.201 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-03-03T07:41:52.152 INFO:teuthology.orchestra.run.smithi057.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-03-03T07:41:52.162 DEBUG:teuthology.orchestra.run.smithi057:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-03-03T07:41:52.319 INFO:teuthology.orchestra.run.smithi057.stdout:Reading package lists... 2023-03-03T07:41:52.517 INFO:teuthology.orchestra.run.smithi057.stdout:Building dependency tree... 2023-03-03T07:41:52.518 INFO:teuthology.orchestra.run.smithi057.stdout:Reading state information... 2023-03-03T07:41:52.705 INFO:teuthology.orchestra.run.smithi057.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-03-03T07:41:52.706 INFO:teuthology.orchestra.run.smithi057.stdout:flex is already the newest version (2.6.4-6.2). 2023-03-03T07:41:52.706 INFO:teuthology.orchestra.run.smithi057.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-03-03T07:41:52.706 INFO:teuthology.orchestra.run.smithi057.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-03-03T07:41:52.706 INFO:teuthology.orchestra.run.smithi057.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-03-03T07:41:52.706 INFO:teuthology.orchestra.run.smithi057.stdout:util-linux is already the newest version (2.34-0.1ubuntu9.3). 2023-03-03T07:41:52.706 INFO:teuthology.orchestra.run.smithi057.stdout:uuid-dev is already the newest version (2.34-0.1ubuntu9.3). 2023-03-03T07:41:52.707 INFO:teuthology.orchestra.run.smithi057.stdout:The following packages were automatically installed and are no longer required: 2023-03-03T07:41:52.707 INFO:teuthology.orchestra.run.smithi057.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-03-03T07:41:52.708 INFO:teuthology.orchestra.run.smithi057.stdout:Use 'sudo apt autoremove' to remove them. 2023-03-03T07:41:52.708 INFO:teuthology.orchestra.run.smithi057.stdout:The following additional packages will be installed: 2023-03-03T07:41:52.708 INFO:teuthology.orchestra.run.smithi057.stdout: libbluetooth3 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 2023-03-03T07:41:52.708 INFO:teuthology.orchestra.run.smithi057.stdout: libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 modemmanager 2023-03-03T07:41:52.708 INFO:teuthology.orchestra.run.smithi057.stdout: network-manager-pptp postgresql-12 postgresql-client-12 2023-03-03T07:41:52.708 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql-client-common ppp pptp-linux usb-modeswitch usb-modeswitch-data 2023-03-03T07:41:52.708 INFO:teuthology.orchestra.run.smithi057.stdout: wpasupplicant 2023-03-03T07:41:52.709 INFO:teuthology.orchestra.run.smithi057.stdout:Suggested packages: 2023-03-03T07:41:52.709 INFO:teuthology.orchestra.run.smithi057.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2023-03-03T07:41:52.710 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql-doc-12 libjson-perl comgt wvdial wpagui libengine-pkcs11-openssl 2023-03-03T07:41:52.819 INFO:teuthology.orchestra.run.smithi057.stdout:The following NEW packages will be installed: 2023-03-03T07:41:52.819 INFO:teuthology.orchestra.run.smithi057.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-03-03T07:41:52.820 INFO:teuthology.orchestra.run.smithi057.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2023-03-03T07:41:52.820 INFO:teuthology.orchestra.run.smithi057.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-03-03T07:41:52.820 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2023-03-03T07:41:52.820 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2023-03-03T07:41:52.821 INFO:teuthology.orchestra.run.smithi057.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-03-03T07:41:52.821 INFO:teuthology.orchestra.run.smithi057.stdout:The following packages will be upgraded: 2023-03-03T07:41:52.821 INFO:teuthology.orchestra.run.smithi057.stdout: libssl1.1 2023-03-03T07:41:53.021 INFO:teuthology.orchestra.run.smithi057.stdout:1 upgraded, 31 newly installed, 0 to remove and 151 not upgraded. 2023-03-03T07:41:53.021 INFO:teuthology.orchestra.run.smithi057.stdout:Need to get 24.0 MB of archives. 2023-03-03T07:41:53.022 INFO:teuthology.orchestra.run.smithi057.stdout:After this operation, 79.9 MB of additional disk space will be used. 2023-03-03T07:41:53.022 INFO:teuthology.orchestra.run.smithi057.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.17 [1,322 kB] 2023-03-03T07:41:53.664 INFO:teuthology.orchestra.run.smithi057.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-03-03T07:41:53.666 INFO:teuthology.orchestra.run.smithi057.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-03-03T07:41:53.672 INFO:teuthology.orchestra.run.smithi057.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2023-03-03T07:41:53.675 INFO:teuthology.orchestra.run.smithi057.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-03-03T07:41:53.675 INFO:teuthology.orchestra.run.smithi057.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-03-03T07:41:53.678 INFO:teuthology.orchestra.run.smithi057.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2023-03-03T07:41:53.681 INFO:teuthology.orchestra.run.smithi057.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-03-03T07:41:53.686 INFO:teuthology.orchestra.run.smithi057.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-03-03T07:41:53.686 INFO:teuthology.orchestra.run.smithi057.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-03-03T07:41:53.743 INFO:teuthology.orchestra.run.smithi057.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-03-03T07:41:53.906 INFO:teuthology.orchestra.run.smithi057.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-03-03T07:41:54.399 INFO:teuthology.orchestra.run.smithi057.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.14-0ubuntu0.20.04.1 [116 kB] 2023-03-03T07:41:54.417 INFO:teuthology.orchestra.run.smithi057.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-03-03T07:41:54.536 INFO:teuthology.orchestra.run.smithi057.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-03-03T07:41:54.537 INFO:teuthology.orchestra.run.smithi057.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.17 [1,585 kB] 2023-03-03T07:41:54.655 INFO:teuthology.orchestra.run.smithi057.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-03-03T07:41:54.656 INFO:teuthology.orchestra.run.smithi057.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-03-03T07:41:54.687 INFO:teuthology.orchestra.run.smithi057.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-03-03T07:41:54.722 INFO:teuthology.orchestra.run.smithi057.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-03-03T07:41:54.766 INFO:teuthology.orchestra.run.smithi057.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-03-03T07:41:54.775 INFO:teuthology.orchestra.run.smithi057.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-03-03T07:41:54.938 INFO:teuthology.orchestra.run.smithi057.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-03-03T07:41:55.125 INFO:teuthology.orchestra.run.smithi057.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2023-03-03T07:41:55.175 INFO:teuthology.orchestra.run.smithi057.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.14-0ubuntu0.20.04.1 [1,053 kB] 2023-03-03T07:41:55.549 INFO:teuthology.orchestra.run.smithi057.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2023-03-03T07:41:55.563 INFO:teuthology.orchestra.run.smithi057.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.14-0ubuntu0.20.04.1 [13.5 MB] 2023-03-03T07:41:55.992 INFO:teuthology.orchestra.run.smithi057.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2023-03-03T07:41:55.992 INFO:teuthology.orchestra.run.smithi057.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2023-03-03T07:41:55.992 INFO:teuthology.orchestra.run.smithi057.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2023-03-03T07:41:55.993 INFO:teuthology.orchestra.run.smithi057.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-03-03T07:41:55.993 INFO:teuthology.orchestra.run.smithi057.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-03-03T07:41:56.663 INFO:teuthology.orchestra.run.smithi057.stdout:Preconfiguring packages ... 2023-03-03T07:41:56.969 INFO:teuthology.orchestra.run.smithi057.stdout:Fetched 24.0 MB in 3s (7,580 kB/s) 2023-03-03T07:41:57.339 INFO:teuthology.orchestra.run.smithi057.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118876 files and directories currently installed.) 2023-03-03T07:41:57.343 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../00-libssl1.1_1.1.1f-1ubuntu2.17_amd64.deb ... 2023-03-03T07:41:57.525 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.17) over (1.1.1f-1ubuntu2.16) ... 2023-03-03T07:41:58.104 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-03-03T07:41:58.120 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2_amd64.deb ... 2023-03-03T07:41:58.163 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-03-03T07:41:58.557 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package dump. 2023-03-03T07:41:58.572 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../02-dump_0.4b46-6_amd64.deb ... 2023-03-03T07:41:58.616 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking dump (0.4b46-6) ... 2023-03-03T07:41:59.003 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package indent. 2023-03-03T07:41:59.019 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../03-indent_2.2.12-1_amd64.deb ... 2023-03-03T07:41:59.062 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking indent (2.2.12-1) ... 2023-03-03T07:41:59.440 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-03-03T07:41:59.462 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-5_amd64.deb ... 2023-03-03T07:41:59.682 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-03-03T07:42:00.112 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-03-03T07:42:00.127 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../05-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-03-03T07:42:00.170 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-03-03T07:42:00.506 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-03-03T07:42:00.521 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../06-libelf-dev_0.176-1.1build1_amd64.deb ... 2023-03-03T07:42:00.564 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2023-03-03T07:42:00.993 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-03-03T07:42:01.014 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../07-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-03-03T07:42:01.068 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-03-03T07:42:01.395 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libmbim-proxy. 2023-03-03T07:42:01.418 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../08-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-03-03T07:42:01.462 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-03-03T07:42:01.848 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-03-03T07:42:01.870 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../09-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-03-03T07:42:01.914 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-03-03T07:42:02.338 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libndp0:amd64. 2023-03-03T07:42:02.360 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../10-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-03-03T07:42:02.404 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-03-03T07:42:02.790 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libnm0:amd64. 2023-03-03T07:42:02.813 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../11-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-03-03T07:42:02.856 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-03-03T07:42:03.284 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libpq5:amd64. 2023-03-03T07:42:03.306 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../12-libpq5_12.14-0ubuntu0.20.04.1_amd64.deb ... 2023-03-03T07:42:03.351 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libpq5:amd64 (12.14-0ubuntu0.20.04.1) ... 2023-03-03T07:42:03.796 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-03-03T07:42:03.818 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../13-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-03-03T07:42:03.862 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-03-03T07:42:04.248 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libqmi-proxy. 2023-03-03T07:42:04.271 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../14-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-03-03T07:42:04.315 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-03-03T07:42:04.634 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-03-03T07:42:04.655 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../15-libssl-dev_1.1.1f-1ubuntu2.17_amd64.deb ... 2023-03-03T07:42:04.692 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.17) ... 2023-03-03T07:42:05.249 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-03-03T07:42:05.270 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../16-libteamdctl0_1.30-1_amd64.deb ... 2023-03-03T07:42:05.315 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-03-03T07:42:05.752 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package modemmanager. 2023-03-03T07:42:05.774 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../17-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-03-03T07:42:05.850 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-03-03T07:42:06.608 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package wpasupplicant. 2023-03-03T07:42:06.630 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../18-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-03-03T07:42:06.674 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-03-03T07:42:07.331 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package network-manager. 2023-03-03T07:42:07.353 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../19-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-03-03T07:42:07.470 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-03-03T07:42:08.322 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ppp. 2023-03-03T07:42:08.343 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../20-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-03-03T07:42:08.945 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-03-03T07:42:09.369 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package pptp-linux. 2023-03-03T07:42:09.391 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../21-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-03-03T07:42:09.435 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-03-03T07:42:09.856 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package network-manager-pptp. 2023-03-03T07:42:09.878 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../22-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-03-03T07:42:09.983 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-03-03T07:42:10.359 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package postgresql-client-common. 2023-03-03T07:42:10.381 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../23-postgresql-client-common_214ubuntu0.1_all.deb ... 2023-03-03T07:42:10.425 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2023-03-03T07:42:10.855 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package postgresql-client-12. 2023-03-03T07:42:10.875 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../24-postgresql-client-12_12.14-0ubuntu0.20.04.1_amd64.deb ... 2023-03-03T07:42:10.912 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking postgresql-client-12 (12.14-0ubuntu0.20.04.1) ... 2023-03-03T07:42:11.584 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package postgresql-common. 2023-03-03T07:42:11.606 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../25-postgresql-common_214ubuntu0.1_all.deb ... 2023-03-03T07:42:11.696 INFO:teuthology.orchestra.run.smithi057.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-03-03T07:42:11.732 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2023-03-03T07:42:12.258 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package postgresql-12. 2023-03-03T07:42:12.280 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../26-postgresql-12_12.14-0ubuntu0.20.04.1_amd64.deb ... 2023-03-03T07:42:12.341 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking postgresql-12 (12.14-0ubuntu0.20.04.1) ... 2023-03-03T07:42:14.037 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package postgresql. 2023-03-03T07:42:14.060 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../27-postgresql_12+214ubuntu0.1_all.deb ... 2023-03-03T07:42:14.103 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2023-03-03T07:42:14.431 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package postgresql-client. 2023-03-03T07:42:14.453 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../28-postgresql-client_12+214ubuntu0.1_all.deb ... 2023-03-03T07:42:14.497 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2023-03-03T07:42:14.816 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package postgresql-contrib. 2023-03-03T07:42:14.839 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../29-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2023-03-03T07:42:14.882 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2023-03-03T07:42:15.185 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-03-03T07:42:15.208 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../30-usb-modeswitch-data_20191128-3_all.deb ... 2023-03-03T07:42:15.251 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-03-03T07:42:15.722 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package usb-modeswitch. 2023-03-03T07:42:15.744 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../31-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-03-03T07:42:15.818 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-03-03T07:42:16.190 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2023-03-03T07:42:16.394 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.17) ... 2023-03-03T07:42:16.805 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libpq5:amd64 (12.14-0ubuntu0.20.04.1) ... 2023-03-03T07:42:16.930 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-03-03T07:42:17.057 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-03-03T07:42:17.182 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-03-03T07:42:17.632 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-03-03T07:42:17.632 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-03-03T07:42:18.761 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up postgresql-client-12 (12.14-0ubuntu0.20.04.1) ... 2023-03-03T07:42:21.788 INFO:teuthology.orchestra.run.smithi057.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-03-03T07:42:21.908 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-03-03T07:42:22.034 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2023-03-03T07:42:23.422 INFO:teuthology.orchestra.run.smithi057.stdout:Adding user postgres to group ssl-cert 2023-03-03T07:42:23.878 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-03T07:42:23.878 INFO:teuthology.orchestra.run.smithi057.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-03-03T07:42:24.590 INFO:teuthology.orchestra.run.smithi057.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-03-03T07:42:24.590 INFO:teuthology.orchestra.run.smithi057.stdout:Removing obsolete dictionary files: 2023-03-03T07:42:25.233 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-03-03T07:42:27.021 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.17) ... 2023-03-03T07:42:27.145 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-03-03T07:42:27.272 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2023-03-03T07:42:27.398 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-03-03T07:42:27.524 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-03-03T07:42:28.868 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-03-03T07:42:29.388 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up dump (0.4b46-6) ... 2023-03-03T07:42:29.509 INFO:teuthology.orchestra.run.smithi057.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-03-03T07:42:29.573 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-03-03T07:42:29.699 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-03-03T07:42:29.833 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up indent (2.2.12-1) ... 2023-03-03T07:42:29.968 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-03-03T07:42:30.161 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-03-03T07:42:30.296 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up postgresql-12 (12.14-0ubuntu0.20.04.1) ... 2023-03-03T07:42:30.884 INFO:teuthology.orchestra.run.smithi057.stdout:Creating new PostgreSQL cluster 12/main ... 2023-03-03T07:42:30.931 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2023-03-03T07:42:31.013 INFO:teuthology.orchestra.run.smithi057.stdout:The files belonging to this database system will be owned by user "postgres". 2023-03-03T07:42:31.013 INFO:teuthology.orchestra.run.smithi057.stdout:This user must also own the server process. 2023-03-03T07:42:31.013 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-03T07:42:31.013 INFO:teuthology.orchestra.run.smithi057.stdout:The database cluster will be initialized with locale "en_US". 2023-03-03T07:42:31.014 INFO:teuthology.orchestra.run.smithi057.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-03-03T07:42:31.014 INFO:teuthology.orchestra.run.smithi057.stdout:The default text search configuration will be set to "english". 2023-03-03T07:42:31.014 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-03T07:42:31.014 INFO:teuthology.orchestra.run.smithi057.stdout:Data page checksums are disabled. 2023-03-03T07:42:31.014 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-03T07:42:31.015 INFO:teuthology.orchestra.run.smithi057.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2023-03-03T07:42:31.018 INFO:teuthology.orchestra.run.smithi057.stdout:creating subdirectories ... ok 2023-03-03T07:42:31.019 INFO:teuthology.orchestra.run.smithi057.stdout:selecting dynamic shared memory implementation ... posix 2023-03-03T07:42:31.069 INFO:teuthology.orchestra.run.smithi057.stdout:selecting default max_connections ... 100 2023-03-03T07:42:31.130 INFO:teuthology.orchestra.run.smithi057.stdout:selecting default shared_buffers ... 128MB 2023-03-03T07:42:31.158 INFO:teuthology.orchestra.run.smithi057.stdout:selecting default time zone ... Etc/UTC 2023-03-03T07:42:31.159 INFO:teuthology.orchestra.run.smithi057.stdout:creating configuration files ... ok 2023-03-03T07:42:31.409 INFO:teuthology.orchestra.run.smithi057.stdout:running bootstrap script ... ok 2023-03-03T07:42:32.161 INFO:teuthology.orchestra.run.smithi057.stdout:performing post-bootstrap initialization ... ok 2023-03-03T07:42:32.776 INFO:teuthology.orchestra.run.smithi057.stdout:syncing data to disk ... ok 2023-03-03T07:42:32.776 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-03T07:42:32.776 INFO:teuthology.orchestra.run.smithi057.stdout:Success. You can now start the database server using: 2023-03-03T07:42:32.777 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-03T07:42:32.777 INFO:teuthology.orchestra.run.smithi057.stdout: pg_ctlcluster 12 main start 2023-03-03T07:42:32.777 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-03T07:42:33.480 INFO:teuthology.orchestra.run.smithi057.stdout:Ver Cluster Port Status Owner Data directory Log file 2023-03-03T07:42:33.480 INFO:teuthology.orchestra.run.smithi057.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2023-03-03T07:42:33.794 INFO:teuthology.orchestra.run.smithi057.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-03-03T07:42:37.754 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-03-03T07:42:37.880 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-03-03T07:42:38.048 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2023-03-03T07:42:38.174 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-03-03T07:42:39.627 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-03T07:42:39.627 INFO:teuthology.orchestra.run.smithi057.stdout:The following network interfaces were found in /etc/network/interfaces 2023-03-03T07:42:39.627 INFO:teuthology.orchestra.run.smithi057.stdout:which means they are currently configured by ifupdown: 2023-03-03T07:42:39.627 INFO:teuthology.orchestra.run.smithi057.stdout:- ens1f0 2023-03-03T07:42:39.627 INFO:teuthology.orchestra.run.smithi057.stdout:If you want to manage those interfaces with NetworkManager instead 2023-03-03T07:42:39.628 INFO:teuthology.orchestra.run.smithi057.stdout:remove their configuration from /etc/network/interfaces. 2023-03-03T07:42:39.628 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-03T07:42:39.895 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-03-03T07:42:40.569 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-03-03T07:42:41.736 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-03-03T07:42:42.902 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-03-03T07:42:43.036 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-03-03T07:42:43.213 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2023-03-03T07:42:43.364 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2023-03-03T07:42:43.491 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-03-03T07:42:43.617 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-03-03T07:42:43.743 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-03-03T07:42:44.095 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-03-03T07:42:44.095 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-03-03T07:42:45.261 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-03-03T07:42:45.639 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-03-03T07:42:45.848 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-03-03T07:42:46.450 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-03-03T07:43:00.979 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-03-03T07:43:01.096 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-03-03T07:43:02.626 INFO:teuthology.orchestra.run.smithi057.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-03-03T07:43:02.636 DEBUG:teuthology.parallel:result is None 2023-03-03T07:43:02.637 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=472aaef4ec3b3a2c29f73ca67854785a910f1f9b 2023-03-03T07:43:02.783 DEBUG:teuthology.orchestra.run.smithi057:> dpkg-query -W -f '${Version}' ceph 2023-03-03T07:43:02.826 INFO:teuthology.orchestra.run.smithi057.stdout:18.0.0-2739-g472aaef4-1focal 2023-03-03T07:43:02.827 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-2739-g472aaef4-1focal 2023-03-03T07:43:02.827 INFO:teuthology.task.install:The correct ceph version 18.0.0-2739-g472aaef4-1focal is installed. 2023-03-03T07:43:02.827 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-03-03T07:43:02.828 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-03-03T07:43:02.828 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-03-03T07:43:02.912 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-03-03T07:43:02.913 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-03-03T07:43:02.913 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/daemon-helper 2023-03-03T07:43:03.001 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-03-03T07:43:03.090 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-03-03T07:43:03.090 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-03-03T07:43:03.090 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/adjust-ulimits 2023-03-03T07:43:03.177 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-03-03T07:43:03.266 INFO:teuthology.run_tasks:Running task ceph... 2023-03-03T07:43:03.365 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-03-03T07:43:03.366 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 777 /var/log/ceph 2023-03-03T07:43:03.410 INFO:tasks.ceph:Disabling ceph logrotate... 2023-03-03T07:43:03.411 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f -- /etc/logrotate.d/ceph 2023-03-03T07:43:03.493 INFO:tasks.ceph:Creating extra log directories... 2023-03-03T07:43:03.494 DEBUG:teuthology.orchestra.run.smithi057:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-03-03T07:43:03.596 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-03-03T07:43:03.596 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-03-03T07:43:03.597 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-03-03T07:43:03.597 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-03-03T07:43:03.597 DEBUG:teuthology.orchestra.run.smithi057:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-03-03T07:43:03.648 DEBUG:teuthology.orchestra.run.smithi057:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-03-03T07:43:03.816 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-03-03T07:43:03.817 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'osd_pool_default_min_size': 1, 'osd_pool_default_size': 1}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 1073741824, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_NEARFULL', 'POOL_BACKFILLFULL', 'PG_DEGRADED', 'OSD_OUT_OF_ORDER_FULL', 'OSD_NEARFULL', 'OSD_FULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-03-03T07:43:03.817 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2023-03-03_04:39:14-fs-wip-vshankar-testing-20230303.023823-testing-default-smithi/7192208', 'branch': 'wip-vshankar-testing-20230303.023823', 'description': 'fs/full/{begin/{0-install 1-ceph 2-logrotate} clusters/1-node-1-mds-1-osd conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mgr-osd-full}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7192208', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '75534f74ac3dd06f86697ff862e8be2945b3c8e6'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2023-03-03_04:39:14-fs-wip-vshankar-testing-20230303.023823-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 1, 'size': 5}}, {'machine': {'disk': 10}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20230303.023823'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'osd_pool_default_min_size': 1, 'osd_pool_default_size': 1}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 1073741824, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_NEARFULL', 'POOL_BACKFILLFULL', 'PG_DEGRADED', 'OSD_OUT_OF_ORDER_FULL', 'OSD_NEARFULL', 'OSD_FULL'], 'sha1': '472aaef4ec3b3a2c29f73ca67854785a910f1f9b'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '472aaef4ec3b3a2c29f73ca67854785a910f1f9b'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20230303.023823', 'sha1': '472aaef4ec3b3a2c29f73ca67854785a910f1f9b'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'mds.a', 'osd.0', 'client.0']], 'sha1': '472aaef4ec3b3a2c29f73ca67854785a910f1f9b', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20230303.023823', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_472aaef4ec3b3a2c29f73ca67854785a910f1f9b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '472aaef4ec3b3a2c29f73ca67854785a910f1f9b', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi057.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '75534f74ac3dd06f86697ff862e8be2945b3c8e6'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '472aaef4ec3b3a2c29f73ca67854785a910f1f9b'}}, {'ceph': None}, {'ceph-fuse': None}, {'workunit': {'cleanup': True, 'clients': {'client.0': ['fs/full/subvolume_rm.sh']}}}, {'workunit': {'cleanup': True, 'clients': {'client.0': ['fs/full/subvolume_clone.sh']}}}, {'workunit': {'cleanup': True, 'clients': {'client.0': ['fs/full/subvolume_snapshot_rm.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6', 'timestamp': '2023-03-03_04:39:14', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.31660'} 2023-03-03T07:43:03.818 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-03-03T07:43:03.841 DEBUG:teuthology.orchestra.run.smithi057:> sudo install -d -m0777 -- /var/run/ceph 2023-03-03T07:43:03.934 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-03-03T07:43:03.934 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/scratch_devs of=/dev/stdout 2023-03-03T07:43:03.997 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-03-03T07:43:03.997 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_1 2023-03-03T07:43:04.061 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-03-03T07:43:04.061 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-03T07:43:04.062 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 5h/5d Inode: 498 Links: 1 2023-03-03T07:43:04.062 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-03T07:43:04.062 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2023-03-03 07:37:25.797472478 +0000 2023-03-03T07:43:04.062 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2023-03-03 07:37:25.233485125 +0000 2023-03-03T07:43:04.062 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2023-03-03 07:37:25.233485125 +0000 2023-03-03T07:43:04.062 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: - 2023-03-03T07:43:04.063 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-03-03T07:43:04.145 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2023-03-03T07:43:04.145 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2023-03-03T07:43:04.146 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000804893 s, 636 kB/s 2023-03-03T07:43:04.150 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-03-03T07:43:04.228 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_2 2023-03-03T07:43:04.294 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-03-03T07:43:04.294 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-03T07:43:04.295 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 5h/5d Inode: 505 Links: 1 2023-03-03T07:43:04.295 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-03T07:43:04.295 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2023-03-03 07:37:26.693452385 +0000 2023-03-03T07:43:04.295 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2023-03-03 07:37:26.145464674 +0000 2023-03-03T07:43:04.295 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2023-03-03 07:37:26.145464674 +0000 2023-03-03T07:43:04.295 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: - 2023-03-03T07:43:04.296 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-03-03T07:43:04.378 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2023-03-03T07:43:04.378 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2023-03-03T07:43:04.379 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000648244 s, 790 kB/s 2023-03-03T07:43:04.384 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-03-03T07:43:04.462 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_3 2023-03-03T07:43:04.527 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-03-03T07:43:04.527 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-03T07:43:04.527 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 5h/5d Inode: 512 Links: 1 2023-03-03T07:43:04.528 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-03T07:43:04.528 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2023-03-03 07:37:27.577432559 +0000 2023-03-03T07:43:04.528 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2023-03-03 07:37:27.049444401 +0000 2023-03-03T07:43:04.528 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2023-03-03 07:37:27.049444401 +0000 2023-03-03T07:43:04.528 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: - 2023-03-03T07:43:04.529 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-03-03T07:43:04.611 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2023-03-03T07:43:04.611 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2023-03-03T07:43:04.611 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000779953 s, 656 kB/s 2023-03-03T07:43:04.615 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-03-03T07:43:04.687 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_4 2023-03-03T07:43:04.751 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-03-03T07:43:04.751 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-03T07:43:04.752 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 5h/5d Inode: 515 Links: 1 2023-03-03T07:43:04.752 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-03T07:43:04.752 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2023-03-03 07:37:28.453412912 +0000 2023-03-03T07:43:04.752 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2023-03-03 07:37:27.925424754 +0000 2023-03-03T07:43:04.752 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2023-03-03 07:37:27.925424754 +0000 2023-03-03T07:43:04.752 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: - 2023-03-03T07:43:04.753 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-03-03T07:43:04.835 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2023-03-03T07:43:04.835 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2023-03-03T07:43:04.835 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000893061 s, 573 kB/s 2023-03-03T07:43:04.839 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-03-03T07:43:04.913 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2023-03-03T07:43:04.913 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi057.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}} 2023-03-03T07:43:04.914 INFO:tasks.ceph:Generating config... 2023-03-03T07:43:04.915 INFO:tasks.ceph:[client] client mount timeout = 600 2023-03-03T07:43:04.915 INFO:tasks.ceph:[client] debug client = 20 2023-03-03T07:43:04.915 INFO:tasks.ceph:[client] debug ms = 1 2023-03-03T07:43:04.916 INFO:tasks.ceph:[client] pid file = 2023-03-03T07:43:04.916 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-03-03T07:43:04.916 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-03-03T07:43:04.917 INFO:tasks.ceph:[global] osd_pool_default_min_size = 1 2023-03-03T07:43:04.917 INFO:tasks.ceph:[global] osd_pool_default_size = 1 2023-03-03T07:43:04.917 INFO:tasks.ceph:[mds] debug mds = 20 2023-03-03T07:43:04.917 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-03-03T07:43:04.918 INFO:tasks.ceph:[mds] debug ms = 1 2023-03-03T07:43:04.918 INFO:tasks.ceph:[mds] mds debug frag = True 2023-03-03T07:43:04.918 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-03-03T07:43:04.918 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-03-03T07:43:04.918 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-03-03T07:43:04.919 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-03-03T07:43:04.919 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-03-03T07:43:04.919 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-03-03T07:43:04.919 INFO:tasks.ceph:[mgr] debug client = 20 2023-03-03T07:43:04.919 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-03-03T07:43:04.920 INFO:tasks.ceph:[mgr] debug ms = 1 2023-03-03T07:43:04.920 INFO:tasks.ceph:[mon] debug mon = 20 2023-03-03T07:43:04.920 INFO:tasks.ceph:[mon] debug ms = 1 2023-03-03T07:43:04.920 INFO:tasks.ceph:[mon] debug paxos = 20 2023-03-03T07:43:04.921 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-03-03T07:43:04.921 INFO:tasks.ceph:[osd] bdev async discard = True 2023-03-03T07:43:04.921 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-03-03T07:43:04.921 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-03-03T07:43:04.921 INFO:tasks.ceph:[osd] bluestore block size = 1073741824 2023-03-03T07:43:04.922 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-03-03T07:43:04.922 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-03-03T07:43:04.922 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-03-03T07:43:04.922 INFO:tasks.ceph:[osd] debug ms = 1 2023-03-03T07:43:04.922 INFO:tasks.ceph:[osd] debug osd = 20 2023-03-03T07:43:04.922 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-03-03T07:43:04.923 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-03-03T07:43:04.923 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-03-03T07:43:04.923 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-03-03T07:43:04.923 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-03-03T07:43:04.924 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-03-03T07:43:04.924 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-03-03T07:43:04.924 INFO:tasks.ceph:Setting up mon.a... 2023-03-03T07:43:04.924 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-03-03T07:43:05.041 INFO:teuthology.orchestra.run.smithi057.stdout:creating /etc/ceph/ceph.keyring 2023-03-03T07:43:05.060 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-03-03T07:43:05.163 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-03-03T07:43:05.204 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.57')] 2023-03-03T07:43:05.205 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.57', 'osd_pool_default_min_size': 1, 'osd_pool_default_size': 1}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 1073741824, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mds.a': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-03-03T07:43:05.206 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-03-03T07:43:05.206 DEBUG:teuthology.orchestra.run.smithi057:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-03-03T07:43:05.270 DEBUG:teuthology.orchestra.run.smithi057:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.57 --print /home/ubuntu/cephtest/ceph.monmap 2023-03-03T07:43:05.394 INFO:teuthology.orchestra.run.smithi057.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-03-03T07:43:05.395 INFO:teuthology.orchestra.run.smithi057.stdout:monmaptool: generated fsid 5022d617-ad40-4ad9-8d5b-120958296d9c 2023-03-03T07:43:05.395 INFO:teuthology.orchestra.run.smithi057.stdout:setting min_mon_release = pacific 2023-03-03T07:43:05.395 INFO:teuthology.orchestra.run.smithi057.stdout:epoch 0 2023-03-03T07:43:05.395 INFO:teuthology.orchestra.run.smithi057.stdout:fsid 5022d617-ad40-4ad9-8d5b-120958296d9c 2023-03-03T07:43:05.395 INFO:teuthology.orchestra.run.smithi057.stdout:last_changed 2023-03-03T07:43:05.392866+0000 2023-03-03T07:43:05.395 INFO:teuthology.orchestra.run.smithi057.stdout:created 2023-03-03T07:43:05.392866+0000 2023-03-03T07:43:05.395 INFO:teuthology.orchestra.run.smithi057.stdout:min_mon_release 16 (pacific) 2023-03-03T07:43:05.396 INFO:teuthology.orchestra.run.smithi057.stdout:election_strategy: 1 2023-03-03T07:43:05.396 INFO:teuthology.orchestra.run.smithi057.stdout:0: [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] mon.a 2023-03-03T07:43:05.396 INFO:teuthology.orchestra.run.smithi057.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2023-03-03T07:43:05.401 DEBUG:teuthology.orchestra.run.smithi057:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-03-03T07:43:05.422 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 5022d617-ad40-4ad9-8d5b-120958296d9c... 2023-03-03T07:43:05.423 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-03-03T07:43:05.572 INFO:teuthology.orchestra.run.smithi057.stdout:[global] 2023-03-03T07:43:05.573 INFO:teuthology.orchestra.run.smithi057.stdout: chdir = "" 2023-03-03T07:43:05.573 INFO:teuthology.orchestra.run.smithi057.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-03-03T07:43:05.573 INFO:teuthology.orchestra.run.smithi057.stdout: auth supported = cephx 2023-03-03T07:43:05.573 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-03T07:43:05.573 INFO:teuthology.orchestra.run.smithi057.stdout: filestore xattr use omap = true 2023-03-03T07:43:05.573 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-03T07:43:05.574 INFO:teuthology.orchestra.run.smithi057.stdout: mon clock drift allowed = 1.000 2023-03-03T07:43:05.574 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-03T07:43:05.574 INFO:teuthology.orchestra.run.smithi057.stdout: osd crush chooseleaf type = 0 2023-03-03T07:43:05.574 INFO:teuthology.orchestra.run.smithi057.stdout: auth debug = true 2023-03-03T07:43:05.574 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-03T07:43:05.574 INFO:teuthology.orchestra.run.smithi057.stdout: ms die on old message = true 2023-03-03T07:43:05.574 INFO:teuthology.orchestra.run.smithi057.stdout: ms die on bug = true 2023-03-03T07:43:05.574 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-03T07:43:05.575 INFO:teuthology.orchestra.run.smithi057.stdout: mon max pg per osd = 10000 # >= luminous 2023-03-03T07:43:05.575 INFO:teuthology.orchestra.run.smithi057.stdout: mon pg warn max object skew = 0 2023-03-03T07:43:05.575 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-03T07:43:05.575 INFO:teuthology.orchestra.run.smithi057.stdout: # disable pg_autoscaler by default for new pools 2023-03-03T07:43:05.575 INFO:teuthology.orchestra.run.smithi057.stdout: osd_pool_default_pg_autoscale_mode = off 2023-03-03T07:43:05.575 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-03T07:43:05.575 INFO:teuthology.orchestra.run.smithi057.stdout: osd pool default size = 2 2023-03-03T07:43:05.575 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-03T07:43:05.576 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd allow primary affinity = true 2023-03-03T07:43:05.576 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd allow pg remap = true 2023-03-03T07:43:05.576 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on legacy crush tunables = false 2023-03-03T07:43:05.576 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on crush straw calc version zero = false 2023-03-03T07:43:05.576 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on no sortbitwise = false 2023-03-03T07:43:05.576 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on osd down out interval zero = false 2023-03-03T07:43:05.576 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on too few osds = false 2023-03-03T07:43:05.576 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-03-03T07:43:05.577 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_pool_no_redundancy = false 2023-03-03T07:43:05.577 INFO:teuthology.orchestra.run.smithi057.stdout: mon_allow_pool_size_one = true 2023-03-03T07:43:05.577 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-03T07:43:05.577 INFO:teuthology.orchestra.run.smithi057.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-03-03T07:43:05.577 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-03T07:43:05.577 INFO:teuthology.orchestra.run.smithi057.stdout: osd default data pool replay window = 5 2023-03-03T07:43:05.577 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-03T07:43:05.577 INFO:teuthology.orchestra.run.smithi057.stdout: mon allow pool delete = true 2023-03-03T07:43:05.578 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-03T07:43:05.578 INFO:teuthology.orchestra.run.smithi057.stdout: mon cluster log file level = debug 2023-03-03T07:43:05.578 INFO:teuthology.orchestra.run.smithi057.stdout: debug asserts on shutdown = true 2023-03-03T07:43:05.580 INFO:teuthology.orchestra.run.smithi057.stdout: mon health detail to clog = false 2023-03-03T07:43:05.580 INFO:teuthology.orchestra.run.smithi057.stdout: mon host = 172.21.15.57 2023-03-03T07:43:05.580 INFO:teuthology.orchestra.run.smithi057.stdout: osd_pool_default_min_size = 1 2023-03-03T07:43:05.581 INFO:teuthology.orchestra.run.smithi057.stdout: osd_pool_default_size = 1 2023-03-03T07:43:05.581 INFO:teuthology.orchestra.run.smithi057.stdout: fsid = 5022d617-ad40-4ad9-8d5b-120958296d9c 2023-03-03T07:43:05.581 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-03T07:43:05.581 INFO:teuthology.orchestra.run.smithi057.stdout:[osd] 2023-03-03T07:43:05.581 INFO:teuthology.orchestra.run.smithi057.stdout: osd journal size = 100 2023-03-03T07:43:05.581 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-03T07:43:05.581 INFO:teuthology.orchestra.run.smithi057.stdout: osd scrub load threshold = 5.0 2023-03-03T07:43:05.582 INFO:teuthology.orchestra.run.smithi057.stdout: osd scrub max interval = 600 2023-03-03T07:43:05.582 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-03T07:43:05.582 INFO:teuthology.orchestra.run.smithi057.stdout: osd recover clone overlap = true 2023-03-03T07:43:05.582 INFO:teuthology.orchestra.run.smithi057.stdout: osd recovery max chunk = 1048576 2023-03-03T07:43:05.582 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-03T07:43:05.582 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug shutdown = true 2023-03-03T07:43:05.582 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug op order = true 2023-03-03T07:43:05.583 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug verify stray on activate = true 2023-03-03T07:43:05.583 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-03T07:43:05.583 INFO:teuthology.orchestra.run.smithi057.stdout: osd open classes on start = true 2023-03-03T07:43:05.583 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug pg log writeout = true 2023-03-03T07:43:05.583 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-03T07:43:05.583 INFO:teuthology.orchestra.run.smithi057.stdout: osd deep scrub update digest min age = 30 2023-03-03T07:43:05.583 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-03T07:43:05.583 INFO:teuthology.orchestra.run.smithi057.stdout: osd map max advance = 10 2023-03-03T07:43:05.584 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-03T07:43:05.584 INFO:teuthology.orchestra.run.smithi057.stdout: journal zero on create = true 2023-03-03T07:43:05.584 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-03T07:43:05.584 INFO:teuthology.orchestra.run.smithi057.stdout: filestore ondisk finisher threads = 3 2023-03-03T07:43:05.584 INFO:teuthology.orchestra.run.smithi057.stdout: filestore apply finisher threads = 3 2023-03-03T07:43:05.584 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-03T07:43:05.584 INFO:teuthology.orchestra.run.smithi057.stdout: bdev debug aio = true 2023-03-03T07:43:05.585 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug misdirected ops = true 2023-03-03T07:43:05.585 INFO:teuthology.orchestra.run.smithi057.stdout: bdev async discard = True 2023-03-03T07:43:05.585 INFO:teuthology.orchestra.run.smithi057.stdout: bdev enable discard = True 2023-03-03T07:43:05.585 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore allocator = bitmap 2023-03-03T07:43:05.585 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore block size = 1073741824 2023-03-03T07:43:05.585 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore fsck on mount = True 2023-03-03T07:43:05.585 INFO:teuthology.orchestra.run.smithi057.stdout: debug bluefs = 1/20 2023-03-03T07:43:05.585 INFO:teuthology.orchestra.run.smithi057.stdout: debug bluestore = 1/20 2023-03-03T07:43:05.586 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2023-03-03T07:43:05.586 INFO:teuthology.orchestra.run.smithi057.stdout: debug osd = 20 2023-03-03T07:43:05.586 INFO:teuthology.orchestra.run.smithi057.stdout: debug rocksdb = 4/10 2023-03-03T07:43:05.586 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd backfillfull_ratio = 0.85 2023-03-03T07:43:05.586 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd full ratio = 0.9 2023-03-03T07:43:05.586 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd nearfull ratio = 0.8 2023-03-03T07:43:05.586 INFO:teuthology.orchestra.run.smithi057.stdout: osd failsafe full ratio = 0.95 2023-03-03T07:43:05.586 INFO:teuthology.orchestra.run.smithi057.stdout: osd objectstore = bluestore 2023-03-03T07:43:05.587 INFO:teuthology.orchestra.run.smithi057.stdout: osd op complaint time = 180 2023-03-03T07:43:05.587 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-03T07:43:05.587 INFO:teuthology.orchestra.run.smithi057.stdout:[mgr] 2023-03-03T07:43:05.587 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2023-03-03T07:43:05.587 INFO:teuthology.orchestra.run.smithi057.stdout: debug mgr = 20 2023-03-03T07:43:05.587 INFO:teuthology.orchestra.run.smithi057.stdout: debug mon = 20 2023-03-03T07:43:05.588 INFO:teuthology.orchestra.run.smithi057.stdout: debug auth = 20 2023-03-03T07:43:05.588 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min pgs per osd = 4 2023-03-03T07:43:05.588 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min bytes per osd = 10 2023-03-03T07:43:05.588 INFO:teuthology.orchestra.run.smithi057.stdout: mgr/telemetry/nag = false 2023-03-03T07:43:05.588 INFO:teuthology.orchestra.run.smithi057.stdout: debug client = 20 2023-03-03T07:43:05.588 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-03T07:43:05.588 INFO:teuthology.orchestra.run.smithi057.stdout:[mon] 2023-03-03T07:43:05.589 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2023-03-03T07:43:05.589 INFO:teuthology.orchestra.run.smithi057.stdout: debug mon = 20 2023-03-03T07:43:05.589 INFO:teuthology.orchestra.run.smithi057.stdout: debug paxos = 20 2023-03-03T07:43:05.589 INFO:teuthology.orchestra.run.smithi057.stdout: debug auth = 20 2023-03-03T07:43:05.589 INFO:teuthology.orchestra.run.smithi057.stdout: mon data avail warn = 5 2023-03-03T07:43:05.589 INFO:teuthology.orchestra.run.smithi057.stdout: mon mgr mkfs grace = 240 2023-03-03T07:43:05.589 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min pgs per osd = 4 2023-03-03T07:43:05.589 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd reporter subtree level = osd 2023-03-03T07:43:05.590 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd prime pg temp = true 2023-03-03T07:43:05.590 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min bytes per osd = 10 2023-03-03T07:43:05.590 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-03T07:43:05.590 INFO:teuthology.orchestra.run.smithi057.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-03-03T07:43:05.590 INFO:teuthology.orchestra.run.smithi057.stdout: auth mon ticket ttl = 660 # 11m 2023-03-03T07:43:05.590 INFO:teuthology.orchestra.run.smithi057.stdout: auth service ticket ttl = 240 # 4m 2023-03-03T07:43:05.590 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-03T07:43:05.590 INFO:teuthology.orchestra.run.smithi057.stdout: # don't complain about insecure global_id in the test suite 2023-03-03T07:43:05.591 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-03-03T07:43:05.591 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-03-03T07:43:05.591 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-03T07:43:05.591 INFO:teuthology.orchestra.run.smithi057.stdout: # 1m isn't quite enough 2023-03-03T07:43:05.591 INFO:teuthology.orchestra.run.smithi057.stdout: mon_down_mkfs_grace = 2m 2023-03-03T07:43:05.591 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-03T07:43:05.591 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_filestore_osds = false 2023-03-03T07:43:05.592 INFO:teuthology.orchestra.run.smithi057.stdout: mon op complaint time = 120 2023-03-03T07:43:05.592 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-03T07:43:05.592 INFO:teuthology.orchestra.run.smithi057.stdout:[client] 2023-03-03T07:43:05.592 INFO:teuthology.orchestra.run.smithi057.stdout: rgw cache enabled = true 2023-03-03T07:43:05.592 INFO:teuthology.orchestra.run.smithi057.stdout: rgw enable ops log = true 2023-03-03T07:43:05.592 INFO:teuthology.orchestra.run.smithi057.stdout: rgw enable usage log = true 2023-03-03T07:43:05.592 INFO:teuthology.orchestra.run.smithi057.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-03-03T07:43:05.592 INFO:teuthology.orchestra.run.smithi057.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-03-03T07:43:05.593 INFO:teuthology.orchestra.run.smithi057.stdout: client mount timeout = 600 2023-03-03T07:43:05.593 INFO:teuthology.orchestra.run.smithi057.stdout: debug client = 20 2023-03-03T07:43:05.593 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2023-03-03T07:43:05.593 INFO:teuthology.orchestra.run.smithi057.stdout: pid file = "" 2023-03-03T07:43:05.593 INFO:teuthology.orchestra.run.smithi057.stdout: rados mon op timeout = 900 2023-03-03T07:43:05.593 INFO:teuthology.orchestra.run.smithi057.stdout: rados osd op timeout = 900 2023-03-03T07:43:05.593 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.a] 2023-03-03T07:43:05.593 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.a] 2023-03-03T07:43:05.594 INFO:teuthology.orchestra.run.smithi057.stdout:[mds] 2023-03-03T07:43:05.594 INFO:teuthology.orchestra.run.smithi057.stdout: debug mds = 20 2023-03-03T07:43:05.594 INFO:teuthology.orchestra.run.smithi057.stdout: debug mds balancer = 20 2023-03-03T07:43:05.594 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2023-03-03T07:43:05.594 INFO:teuthology.orchestra.run.smithi057.stdout: mds debug frag = True 2023-03-03T07:43:05.594 INFO:teuthology.orchestra.run.smithi057.stdout: mds debug scatterstat = True 2023-03-03T07:43:05.594 INFO:teuthology.orchestra.run.smithi057.stdout: mds op complaint time = 180 2023-03-03T07:43:05.594 INFO:teuthology.orchestra.run.smithi057.stdout: mds verify scatter = True 2023-03-03T07:43:05.595 INFO:teuthology.orchestra.run.smithi057.stdout: osd op complaint time = 180 2023-03-03T07:43:05.595 INFO:teuthology.orchestra.run.smithi057.stdout: rados mon op timeout = 900 2023-03-03T07:43:05.595 INFO:teuthology.orchestra.run.smithi057.stdout: rados osd op timeout = 900 2023-03-03T07:43:05.607 INFO:tasks.ceph:Creating admin key on mon.a... 2023-03-03T07:43:05.607 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-03-03T07:43:05.719 INFO:tasks.ceph:Copying monmap to all nodes... 2023-03-03T07:43:05.719 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-03-03T07:43:05.719 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-03-03T07:43:05.736 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-03-03T07:43:05.737 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-03-03T07:43:05.801 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi057.front.sepia.ceph.com 2023-03-03T07:43:05.802 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-03-03T07:43:05.802 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/ceph/ceph.keyring 2023-03-03T07:43:05.802 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-03-03T07:43:05.927 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-03-03T07:43:05.928 DEBUG:teuthology.orchestra.run.smithi057:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-03-03T07:43:05.989 INFO:tasks.ceph:Setting up mon nodes... 2023-03-03T07:43:05.990 INFO:tasks.ceph:Setting up mgr nodes... 2023-03-03T07:43:05.990 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-03-03T07:43:06.162 INFO:teuthology.orchestra.run.smithi057.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-03-03T07:43:06.174 INFO:tasks.ceph:Setting up mds nodes... 2023-03-03T07:43:06.175 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-03-03T07:43:06.302 INFO:teuthology.orchestra.run.smithi057.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-03-03T07:43:06.321 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-03-03T07:43:06.364 INFO:tasks.ceph_client:Setting up client nodes... 2023-03-03T07:43:06.365 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-03-03T07:43:06.502 INFO:teuthology.orchestra.run.smithi057.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-03-03T07:43:06.548 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-03-03T07:43:06.549 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi057.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}} 2023-03-03T07:43:06.550 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-03-03T07:43:06.594 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2023-03-03T07:43:06.594 INFO:tasks.ceph:role: osd.0 2023-03-03T07:43:06.594 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi057.front.sepia.ceph.com 2023-03-03T07:43:06.595 DEBUG:teuthology.orchestra.run.smithi057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-03-03T07:43:08.093 INFO:teuthology.orchestra.run.smithi057.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-03-03T07:43:08.093 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 attr=2, projid32bit=1 2023-03-03T07:43:08.093 INFO:teuthology.orchestra.run.smithi057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-03-03T07:43:08.093 INFO:teuthology.orchestra.run.smithi057.stdout: = reflink=1 2023-03-03T07:43:08.093 INFO:teuthology.orchestra.run.smithi057.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-03-03T07:43:08.094 INFO:teuthology.orchestra.run.smithi057.stdout: = sunit=0 swidth=0 blks 2023-03-03T07:43:08.094 INFO:teuthology.orchestra.run.smithi057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-03-03T07:43:08.094 INFO:teuthology.orchestra.run.smithi057.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-03-03T07:43:08.094 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-03-03T07:43:08.094 INFO:teuthology.orchestra.run.smithi057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-03-03T07:43:08.102 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi057.front.sepia.ceph.com -o noatime 2023-03-03T07:43:08.102 DEBUG:teuthology.orchestra.run.smithi057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-03-03T07:43:08.165 DEBUG:teuthology.orchestra.run.smithi057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-03-03T07:43:08.190 INFO:teuthology.orchestra.run.smithi057.stderr:sudo: /sbin/restorecon: command not found 2023-03-03T07:43:08.191 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-03T07:43:08.192 DEBUG:teuthology.orchestra.run.smithi057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-03-03T07:43:08.373 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:08.368+0000 7fd741cc3700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-03-03T07:43:08.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:08.368+0000 7fd741cc3700 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-03-03T07:43:08.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:08.368+0000 7fd741cc3700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-03-03T07:43:08.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:08.368+0000 7fd741cc3700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-03-03T07:43:08.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:08.368+0000 7fd741cc3700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-03-03T07:43:08.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:08.372+0000 7fd741cc3700 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-03-03T07:43:11.767 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-03-03T07:43:11.809 INFO:tasks.ceph:Reading keys from all nodes... 2023-03-03T07:43:11.810 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-03-03T07:43:11.810 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-03-03T07:43:11.896 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-03-03T07:43:11.896 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-03-03T07:43:11.983 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-03-03T07:43:11.984 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-03-03T07:43:12.065 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-03-03T07:43:12.065 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-03-03T07:43:12.129 INFO:tasks.ceph:Adding keys to all mons... 2023-03-03T07:43:12.130 DEBUG:teuthology.orchestra.run.smithi057:> sudo tee -a /etc/ceph/ceph.keyring 2023-03-03T07:43:12.209 INFO:teuthology.orchestra.run.smithi057.stdout:[mgr.x] 2023-03-03T07:43:12.209 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQAKpQFkb2CTCRAAizl/J3wWwzc86BjkEbYiuQ== 2023-03-03T07:43:12.209 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.a] 2023-03-03T07:43:12.209 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQAKpQFkuBL2ERAAIaXt+PDXh7NrNgq6OV4XAA== 2023-03-03T07:43:12.210 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.0] 2023-03-03T07:43:12.210 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQAMpQFkZscvFhAAP+atlzXf97482tjlJikohw== 2023-03-03T07:43:12.210 INFO:teuthology.orchestra.run.smithi057.stdout:[client.0] 2023-03-03T07:43:12.210 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQAKpQFknrLbHRAAXufZFpNVfOqxgjPQEhnCaQ== 2023-03-03T07:43:12.214 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-03-03T07:43:12.366 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-03-03T07:43:12.476 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-03T07:43:12.588 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-03-03T07:43:12.695 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-03-03T07:43:12.695 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-03-03T07:43:12.739 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-03-03T07:43:12.921 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-03-03T07:43:12.966 DEBUG:teuthology.orchestra.run.smithi057:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-03-03T07:43:13.029 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-03-03T07:43:13.029 INFO:tasks.ceph.mon.a:Restarting daemon 2023-03-03T07:43:13.030 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-03-03T07:43:13.079 INFO:tasks.ceph.mon.a:Started 2023-03-03T07:43:13.079 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-03-03T07:43:13.080 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-03-03T07:43:13.080 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-03-03T07:43:13.085 INFO:tasks.ceph.mgr.x:Started 2023-03-03T07:43:13.085 INFO:tasks.ceph:Setting crush tunables to default 2023-03-03T07:43:13.085 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph osd crush tunables default 2023-03-03T07:43:13.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.260+0000 7fdeb5726700 1 Processor -- start 2023-03-03T07:43:13.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.260+0000 7fdeb5726700 1 -- start start 2023-03-03T07:43:13.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.260+0000 7fdeb5726700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdeb01248d0 0x7fdeb0124ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:13.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.260+0000 7fdeb5726700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeb008c220 con 0x7fdeb008b090 2023-03-03T07:43:13.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.260+0000 7fdeb5726700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeb01243a0 con 0x7fdeb01248d0 2023-03-03T07:43:13.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.260+0000 7fdeaeffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdeb01248d0 0x7fdeb0124ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:13.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.260+0000 7fdeaeffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdeb01248d0 0x7fdeb0124ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50096/0 (socket says 172.21.15.57:50096) 2023-03-03T07:43:13.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.260+0000 7fdeaeffd700 1 -- 172.21.15.57:0/526295902 learned_addr learned my addr 172.21.15.57:0/526295902 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:13.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.260+0000 7fdeaeffd700 1 -- 172.21.15.57:0/526295902 >> v2:172.21.15.57:3300/0 conn(0x7fdeb01248d0 msgr2=0x7fdeb0124ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-03-03T07:43:13.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.260+0000 7fdeaeffd700 1 -- 172.21.15.57:0/526295902 >> v2:172.21.15.57:3300/0 conn(0x7fdeb01248d0 msgr2=0x7fdeb0124ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-03T07:43:13.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.260+0000 7fdeaeffd700 1 --2- 172.21.15.57:0/526295902 >> v2:172.21.15.57:3300/0 conn(0x7fdeb01248d0 0x7fdeb0124ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-03T07:43:13.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.264+0000 7fdeaeffd700 1 --2- 172.21.15.57:0/526295902 >> v2:172.21.15.57:3300/0 conn(0x7fdeb01248d0 0x7fdeb0124ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-03-03T07:43:13.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.268+0000 7fdeadffb700 1 -- 172.21.15.57:0/526295902 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1002383801 0 0) 0x7fdeb008c220 con 0x7fdeb008b090 2023-03-03T07:43:13.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.268+0000 7fdeadffb700 1 -- 172.21.15.57:0/526295902 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde980057e0 con 0x7fdeb008b090 2023-03-03T07:43:13.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.268+0000 7fdeadffb700 1 -- 172.21.15.57:0/526295902 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2535867437 0 0) 0x7fde980057e0 con 0x7fdeb008b090 2023-03-03T07:43:13.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.268+0000 7fdeadffb700 1 -- 172.21.15.57:0/526295902 >> v2:172.21.15.57:3300/0 conn(0x7fdeb01248d0 msgr2=0x7fdeb0124ca0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-03-03T07:43:13.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.268+0000 7fdeadffb700 1 --2- 172.21.15.57:0/526295902 >> v2:172.21.15.57:3300/0 conn(0x7fdeb01248d0 0x7fdeb0124ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:13.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.272+0000 7fdeadffb700 1 -- 172.21.15.57:0/526295902 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb01251e0 con 0x7fdeb008b090 2023-03-03T07:43:13.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.272+0000 7fdeadffb700 1 -- 172.21.15.57:0/526295902 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (unknown 2779775165 0 0) 0x7fdea40017d0 con 0x7fdeb008b090 2023-03-03T07:43:13.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.272+0000 7fdeadffb700 1 -- 172.21.15.57:0/526295902 >> v1:172.21.15.57:6789/0 conn(0x7fdeb008b090 legacy=0x7fdeb008b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:13.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.272+0000 7fdeadffb700 1 --2- 172.21.15.57:0/526295902 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde98005cf0 0x7fde980060e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:13.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.272+0000 7fdeadffb700 1 -- 172.21.15.57:0/526295902 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb01243a0 con 0x7fde98005cf0 2023-03-03T07:43:13.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.272+0000 7fdeaeffd700 1 --2- 172.21.15.57:0/526295902 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde98005cf0 0x7fde980060e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:13.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.272+0000 7fdeaeffd700 1 -- 172.21.15.57:0/526295902 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde980057e0 con 0x7fde98005cf0 2023-03-03T07:43:13.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.272+0000 7fdeaeffd700 1 --2- 172.21.15.57:0/526295902 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde98005cf0 0x7fde980060e0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fdea00098d0 tx=0x7fde98007ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b4727c66becc292 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:13.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.272+0000 7fdeadffb700 1 -- 172.21.15.57:0/526295902 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdea000c070 con 0x7fde98005cf0 2023-03-03T07:43:13.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.272+0000 7fdeadffb700 1 -- 172.21.15.57:0/526295902 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea0004170 con 0x7fde98005cf0 2023-03-03T07:43:13.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.272+0000 7fdeadffb700 1 -- 172.21.15.57:0/526295902 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdea0004450 con 0x7fde98005cf0 2023-03-03T07:43:13.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.276+0000 7fdeb5726700 1 -- 172.21.15.57:0/526295902 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde98005cf0 msgr2=0x7fde980060e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:13.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.276+0000 7fdeb5726700 1 --2- 172.21.15.57:0/526295902 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde98005cf0 0x7fde980060e0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fdea00098d0 tx=0x7fde98007ab0 comp rx=0 tx=0).stop 2023-03-03T07:43:13.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.276+0000 7fdeb5726700 1 -- 172.21.15.57:0/526295902 shutdown_connections 2023-03-03T07:43:13.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.276+0000 7fdeb5726700 1 --2- 172.21.15.57:0/526295902 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde98005cf0 0x7fde980060e0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:13.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.276+0000 7fdeb5726700 1 --2- 172.21.15.57:0/526295902 >> v2:172.21.15.57:3300/0 conn(0x7fdeb01248d0 0x7fdeb0124ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:13.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.276+0000 7fdeb5726700 1 -- 172.21.15.57:0/526295902 >> 172.21.15.57:0/526295902 conn(0x7fdeb0069f00 msgr2=0x7fdeb006a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:13.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.276+0000 7fdeb5726700 1 -- 172.21.15.57:0/526295902 shutdown_connections 2023-03-03T07:43:13.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.276+0000 7fdeb5726700 1 -- 172.21.15.57:0/526295902 wait complete. 2023-03-03T07:43:13.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.276+0000 7fdeb5726700 1 Processor -- start 2023-03-03T07:43:13.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.280+0000 7fdeb5726700 1 -- start start 2023-03-03T07:43:13.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.280+0000 7fdeb5726700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde98005cf0 0x7fdeb01bbb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:13.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.280+0000 7fdeb5726700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb0122e50 con 0x7fde98005cf0 2023-03-03T07:43:13.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.280+0000 7fdeaeffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde98005cf0 0x7fdeb01bbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:13.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.280+0000 7fdeaeffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde98005cf0 0x7fdeb01bbb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50138/0 (socket says 172.21.15.57:50138) 2023-03-03T07:43:13.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.280+0000 7fdeaeffd700 1 -- 172.21.15.57:0/1512582838 learned_addr learned my addr 172.21.15.57:0/1512582838 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:13.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.280+0000 7fdeaeffd700 1 -- 172.21.15.57:0/1512582838 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb008bd80 con 0x7fde98005cf0 2023-03-03T07:43:13.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.280+0000 7fdeaeffd700 1 --2- 172.21.15.57:0/1512582838 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde98005cf0 0x7fdeb01bbb60 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fdeb006ae50 tx=0x7fdea00047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:13.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.284+0000 7fde977fe700 1 -- 172.21.15.57:0/1512582838 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdea001c470 con 0x7fde98005cf0 2023-03-03T07:43:13.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.284+0000 7fde977fe700 1 -- 172.21.15.57:0/1512582838 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea001c5d0 con 0x7fde98005cf0 2023-03-03T07:43:13.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.284+0000 7fde977fe700 1 -- 172.21.15.57:0/1512582838 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdea001c890 con 0x7fde98005cf0 2023-03-03T07:43:13.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.284+0000 7fdeb5726700 1 -- 172.21.15.57:0/1512582838 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeb008bbf0 con 0x7fde98005cf0 2023-03-03T07:43:13.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.284+0000 7fdeb5726700 1 -- 172.21.15.57:0/1512582838 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeb008bf10 con 0x7fde98005cf0 2023-03-03T07:43:13.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.284+0000 7fde977fe700 1 -- 172.21.15.57:0/1512582838 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fdea002d020 con 0x7fde98005cf0 2023-03-03T07:43:13.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.284+0000 7fde977fe700 1 -- 172.21.15.57:0/1512582838 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fdea001dab0 con 0x7fde98005cf0 2023-03-03T07:43:13.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.284+0000 7fdeb5726700 1 -- 172.21.15.57:0/1512582838 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeb0121e30 con 0x7fde98005cf0 2023-03-03T07:43:13.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.288+0000 7fde977fe700 1 -- 172.21.15.57:0/1512582838 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fdeb0121e30 con 0x7fde98005cf0 2023-03-03T07:43:13.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.360+0000 7fdeb5726700 1 -- 172.21.15.57:0/1512582838 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fdeb004eff0 con 0x7fde98005cf0 2023-03-03T07:43:13.373 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.368+0000 7fde977fe700 1 -- 172.21.15.57:0/1512582838 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fdea0017030 con 0x7fde98005cf0 2023-03-03T07:43:13.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.368+0000 7fdeb5726700 1 -- 172.21.15.57:0/1512582838 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde98005cf0 msgr2=0x7fdeb01bbb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:13.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.368+0000 7fdeb5726700 1 --2- 172.21.15.57:0/1512582838 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde98005cf0 0x7fdeb01bbb60 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fdeb006ae50 tx=0x7fdea00047e0 comp rx=0 tx=0).stop 2023-03-03T07:43:13.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.368+0000 7fdeb5726700 1 -- 172.21.15.57:0/1512582838 shutdown_connections 2023-03-03T07:43:13.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.368+0000 7fdeb5726700 1 --2- 172.21.15.57:0/1512582838 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde98005cf0 0x7fdeb01bbb60 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:13.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.368+0000 7fdeb5726700 1 -- 172.21.15.57:0/1512582838 >> 172.21.15.57:0/1512582838 conn(0x7fdeb0069f00 msgr2=0x7fdeb0092a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:13.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.368+0000 7fdeb5726700 1 -- 172.21.15.57:0/1512582838 shutdown_connections 2023-03-03T07:43:13.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.368+0000 7fdeb5726700 1 -- 172.21.15.57:0/1512582838 wait complete. 2023-03-03T07:43:13.378 INFO:teuthology.orchestra.run.smithi057.stderr:adjusted tunables profile to default 2023-03-03T07:43:13.406 INFO:tasks.ceph:check_enable_crimson: False 2023-03-03T07:43:13.407 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-03-03T07:43:13.407 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-03-03T07:43:13.408 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-03-03T07:43:13.451 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph osd new d83f7ba7-9d9d-4309-95b9-2b8ad96f2f8b 0 2023-03-03T07:43:13.540 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:43:13.532+0000 7fde7b2db2c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-03-03T07:43:13.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.680+0000 7f3791b09700 1 Processor -- start 2023-03-03T07:43:13.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.680+0000 7f3791b09700 1 -- start start 2023-03-03T07:43:13.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.684+0000 7f3791b09700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f378c070360 0x7f378c070730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:13.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.684+0000 7f3791b09700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f378c08e660 con 0x7f378c127750 2023-03-03T07:43:13.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.684+0000 7f3791b09700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f378c070c70 con 0x7f378c070360 2023-03-03T07:43:13.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.684+0000 7f378bfff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f378c127750 0x7f378c127bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:41934/0 (socket says 172.21.15.57:41934) 2023-03-03T07:43:13.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.684+0000 7f378bfff700 1 -- 172.21.15.57:0/3402453562 learned_addr learned my addr 172.21.15.57:0/3402453562 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:43:13.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.684+0000 7f3790b07700 1 --2- 172.21.15.57:0/3402453562 >> v2:172.21.15.57:3300/0 conn(0x7f378c070360 0x7f378c070730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:13.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.684+0000 7f378b7fe700 1 -- 172.21.15.57:0/3402453562 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3012305091 0 0) 0x7f378c08e660 con 0x7f378c127750 2023-03-03T07:43:13.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.684+0000 7f378b7fe700 1 -- 172.21.15.57:0/3402453562 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f377c0035d0 con 0x7f378c127750 2023-03-03T07:43:13.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.684+0000 7f3790b07700 1 -- 172.21.15.57:0/3402453562 >> v1:172.21.15.57:6789/0 conn(0x7f378c127750 legacy=0x7f378c127bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:13.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.684+0000 7f3790b07700 1 -- 172.21.15.57:0/3402453562 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f378c0715d0 con 0x7f378c070360 2023-03-03T07:43:13.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.684+0000 7f3790b07700 1 --2- 172.21.15.57:0/3402453562 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f378c070360 0x7f378c070730 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f37800097c0 tx=0x7f3780009ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38efeca83b755fe9 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:13.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.684+0000 7f378b7fe700 1 -- 172.21.15.57:0/3402453562 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3780005d80 con 0x7f378c070360 2023-03-03T07:43:13.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.684+0000 7f378b7fe700 1 -- 172.21.15.57:0/3402453562 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3780004030 con 0x7f378c070360 2023-03-03T07:43:13.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.684+0000 7f378b7fe700 1 -- 172.21.15.57:0/3402453562 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f37800042f0 con 0x7f378c070360 2023-03-03T07:43:13.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.688+0000 7f3791b09700 1 -- 172.21.15.57:0/3402453562 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f378c070360 msgr2=0x7f378c070730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:13.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.688+0000 7f3791b09700 1 --2- 172.21.15.57:0/3402453562 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f378c070360 0x7f378c070730 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f37800097c0 tx=0x7f3780009ad0 comp rx=0 tx=0).stop 2023-03-03T07:43:13.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.688+0000 7f3791b09700 1 -- 172.21.15.57:0/3402453562 shutdown_connections 2023-03-03T07:43:13.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.688+0000 7f3791b09700 1 --2- 172.21.15.57:0/3402453562 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f378c070360 0x7f378c070730 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:13.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.688+0000 7f3791b09700 1 -- 172.21.15.57:0/3402453562 >> 172.21.15.57:0/3402453562 conn(0x7f378c06ba10 msgr2=0x7f378c06de20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:13.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.688+0000 7f3791b09700 1 -- 172.21.15.57:0/3402453562 shutdown_connections 2023-03-03T07:43:13.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.688+0000 7f3791b09700 1 -- 172.21.15.57:0/3402453562 wait complete. 2023-03-03T07:43:13.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.688+0000 7f3791b09700 1 Processor -- start 2023-03-03T07:43:13.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.692+0000 7f3791b09700 1 -- start start 2023-03-03T07:43:13.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.692+0000 7f3791b09700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f378c070360 0x7f378c125420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:13.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.692+0000 7f3791b09700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f378c08f1e0 con 0x7f378c070360 2023-03-03T07:43:13.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.692+0000 7f3790b07700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f378c070360 0x7f378c125420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:13.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.692+0000 7f3790b07700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f378c070360 0x7f378c125420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50154/0 (socket says 172.21.15.57:50154) 2023-03-03T07:43:13.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.692+0000 7f3790b07700 1 -- 172.21.15.57:0/4035042991 learned_addr learned my addr 172.21.15.57:0/4035042991 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:13.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.692+0000 7f3790b07700 1 -- 172.21.15.57:0/4035042991 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3780009450 con 0x7f378c070360 2023-03-03T07:43:13.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.692+0000 7f3790b07700 1 --2- 172.21.15.57:0/4035042991 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f378c070360 0x7f378c125420 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3780000c00 tx=0x7f3780004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:13.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.692+0000 7f37897fa700 1 -- 172.21.15.57:0/4035042991 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f378001c420 con 0x7f378c070360 2023-03-03T07:43:13.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.692+0000 7f37897fa700 1 -- 172.21.15.57:0/4035042991 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f378001c580 con 0x7f378c070360 2023-03-03T07:43:13.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.692+0000 7f37897fa700 1 -- 172.21.15.57:0/4035042991 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f378001c860 con 0x7f378c070360 2023-03-03T07:43:13.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.692+0000 7f3791b09700 1 -- 172.21.15.57:0/4035042991 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f378c128470 con 0x7f378c070360 2023-03-03T07:43:13.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.696+0000 7f3791b09700 1 -- 172.21.15.57:0/4035042991 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f378c1282e0 con 0x7f378c070360 2023-03-03T07:43:13.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.696+0000 7f37897fa700 1 -- 172.21.15.57:0/4035042991 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f3780022030 con 0x7f378c070360 2023-03-03T07:43:13.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.696+0000 7f37897fa700 1 -- 172.21.15.57:0/4035042991 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f3780006e40 con 0x7f378c070360 2023-03-03T07:43:13.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.696+0000 7f3791b09700 1 -- 172.21.15.57:0/4035042991 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f378c12da80 con 0x7f378c070360 2023-03-03T07:43:13.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.700+0000 7f37897fa700 1 -- 172.21.15.57:0/4035042991 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f378002a060 con 0x7f378c070360 2023-03-03T07:43:13.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.780+0000 7f3791b09700 1 -- 172.21.15.57:0/4035042991 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d83f7ba7-9d9d-4309-95b9-2b8ad96f2f8b", "id": 0} v 0) v1 -- 0x7f378c126e70 con 0x7f378c070360 2023-03-03T07:43:13.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.788+0000 7f37897fa700 1 -- 172.21.15.57:0/4035042991 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d83f7ba7-9d9d-4309-95b9-2b8ad96f2f8b", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3780020070 con 0x7f378c070360 2023-03-03T07:43:13.794 INFO:teuthology.orchestra.run.smithi057.stdout:0 2023-03-03T07:43:13.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.788+0000 7f3791b09700 1 -- 172.21.15.57:0/4035042991 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f378c070360 msgr2=0x7f378c125420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:13.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.788+0000 7f3791b09700 1 --2- 172.21.15.57:0/4035042991 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f378c070360 0x7f378c125420 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3780000c00 tx=0x7f3780004770 comp rx=0 tx=0).stop 2023-03-03T07:43:13.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.792+0000 7f3791b09700 1 -- 172.21.15.57:0/4035042991 shutdown_connections 2023-03-03T07:43:13.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.792+0000 7f3791b09700 1 --2- 172.21.15.57:0/4035042991 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f378c070360 0x7f378c125420 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:13.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.792+0000 7f3791b09700 1 -- 172.21.15.57:0/4035042991 >> 172.21.15.57:0/4035042991 conn(0x7f378c06ba10 msgr2=0x7f378c12b480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:13.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.792+0000 7f3791b09700 1 -- 172.21.15.57:0/4035042991 shutdown_connections 2023-03-03T07:43:13.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:13.792+0000 7f3791b09700 1 -- 172.21.15.57:0/4035042991 wait complete. 2023-03-03T07:43:13.828 INFO:tasks.ceph.osd.0:Restarting daemon 2023-03-03T07:43:13.828 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-03-03T07:43:13.883 INFO:tasks.ceph.osd.0:Started 2023-03-03T07:43:13.884 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T07:43:14.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:14.088+0000 7f44355f2700 1 Processor -- start 2023-03-03T07:43:14.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:14.088+0000 7f44355f2700 1 -- start start 2023-03-03T07:43:14.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:14.088+0000 7f44355f2700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f44300948e0 0x7f443006ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:14.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:14.088+0000 7f44355f2700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4430071950 con 0x7f443006f4b0 2023-03-03T07:43:14.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:14.088+0000 7f44355f2700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4430071330 con 0x7f44300948e0 2023-03-03T07:43:14.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:14.088+0000 7f442effd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f44300948e0 0x7f443006ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:14.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:14.088+0000 7f442e7fc700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f443006f4b0 0x7f4430128c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:41956/0 (socket says 172.21.15.57:41956) 2023-03-03T07:43:14.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:14.088+0000 7f442e7fc700 1 -- 172.21.15.57:0/3200753936 learned_addr learned my addr 172.21.15.57:0/3200753936 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:43:14.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:14.088+0000 7f442effd700 1 -- 172.21.15.57:0/3200753936 >> v1:172.21.15.57:6789/0 conn(0x7f443006f4b0 legacy=0x7f4430128c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:14.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:14.088+0000 7f442effd700 1 -- 172.21.15.57:0/3200753936 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4430071640 con 0x7f44300948e0 2023-03-03T07:43:14.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:14.088+0000 7f442dffb700 1 -- 172.21.15.57:0/3200753936 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 657073651 0 0) 0x7f4430071950 con 0x7f443006f4b0 2023-03-03T07:43:14.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:14.088+0000 7f442effd700 1 --2- 172.21.15.57:0/3200753936 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44300948e0 0x7f443006ef70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f44200097d0 tx=0x7f4420009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99597ab91daccef7 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:14.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:14.092+0000 7f442dffb700 1 -- 172.21.15.57:0/3200753936 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f44200041c0 con 0x7f44300948e0 2023-03-03T07:43:14.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:14.092+0000 7f442dffb700 1 -- 172.21.15.57:0/3200753936 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4420004320 con 0x7f44300948e0 2023-03-03T07:43:14.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:14.092+0000 7f442dffb700 1 -- 172.21.15.57:0/3200753936 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f44200036c0 con 0x7f44300948e0 2023-03-03T07:43:14.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:14.092+0000 7f44355f2700 1 -- 172.21.15.57:0/3200753936 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44300948e0 msgr2=0x7f443006ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:14.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:14.092+0000 7f44355f2700 1 --2- 172.21.15.57:0/3200753936 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44300948e0 0x7f443006ef70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f44200097d0 tx=0x7f4420009ae0 comp rx=0 tx=0).stop 2023-03-03T07:43:14.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:14.092+0000 7f44355f2700 1 -- 172.21.15.57:0/3200753936 shutdown_connections 2023-03-03T07:43:14.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:14.092+0000 7f44355f2700 1 --2- 172.21.15.57:0/3200753936 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44300948e0 0x7f443006ef70 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:14.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:14.092+0000 7f44355f2700 1 -- 172.21.15.57:0/3200753936 >> 172.21.15.57:0/3200753936 conn(0x7f4430069f00 msgr2=0x7f443006a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:14.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:14.092+0000 7f44355f2700 1 -- 172.21.15.57:0/3200753936 shutdown_connections 2023-03-03T07:43:14.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:14.092+0000 7f44355f2700 1 -- 172.21.15.57:0/3200753936 wait complete. 2023-03-03T07:43:14.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:14.092+0000 7f44355f2700 1 Processor -- start 2023-03-03T07:43:14.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:14.092+0000 7f44355f2700 1 -- start start 2023-03-03T07:43:14.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:14.096+0000 7f44355f2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f443006f4b0 0x7f443012dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:14.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:14.096+0000 7f44355f2700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f443011b6c0 con 0x7f443006f4b0 2023-03-03T07:43:14.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:14.096+0000 7f442effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f443006f4b0 0x7f443012dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:14.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:14.096+0000 7f442effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f443006f4b0 0x7f443012dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50194/0 (socket says 172.21.15.57:50194) 2023-03-03T07:43:14.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:14.096+0000 7f442effd700 1 -- 172.21.15.57:0/3365300407 learned_addr learned my addr 172.21.15.57:0/3365300407 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:14.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:14.096+0000 7f442effd700 1 -- 172.21.15.57:0/3365300407 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44200094b0 con 0x7f443006f4b0 2023-03-03T07:43:14.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:14.096+0000 7f442effd700 1 --2- 172.21.15.57:0/3365300407 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f443006f4b0 0x7f443012dfc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4420014040 tx=0x7f4420004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:14.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:14.096+0000 7f44177fe700 1 -- 172.21.15.57:0/3365300407 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4420006ea0 con 0x7f443006f4b0 2023-03-03T07:43:14.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:14.096+0000 7f44177fe700 1 -- 172.21.15.57:0/3365300407 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4420011630 con 0x7f443006f4b0 2023-03-03T07:43:14.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:14.096+0000 7f44177fe700 1 -- 172.21.15.57:0/3365300407 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4420011910 con 0x7f443006f4b0 2023-03-03T07:43:14.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:14.096+0000 7f44355f2700 1 -- 172.21.15.57:0/3365300407 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f443006fa60 con 0x7f443006f4b0 2023-03-03T07:43:14.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:14.096+0000 7f44355f2700 1 -- 172.21.15.57:0/3365300407 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f443006f8d0 con 0x7f443006f4b0 2023-03-03T07:43:14.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:14.096+0000 7f44177fe700 1 -- 172.21.15.57:0/3365300407 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f442002d070 con 0x7f443006f4b0 2023-03-03T07:43:14.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:14.096+0000 7f44177fe700 1 -- 172.21.15.57:0/3365300407 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f4420026df0 con 0x7f443006f4b0 2023-03-03T07:43:14.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:14.100+0000 7f44355f2700 1 -- 172.21.15.57:0/3365300407 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f443006fbf0 con 0x7f443006f4b0 2023-03-03T07:43:14.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:14.104+0000 7f44177fe700 1 -- 172.21.15.57:0/3365300407 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f4420045b00 con 0x7f443006f4b0 2023-03-03T07:43:14.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:14.172+0000 7f44355f2700 1 -- 172.21.15.57:0/3365300407 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f443004eff0 con 0x7f443006f4b0 2023-03-03T07:43:14.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:14.176+0000 7f44177fe700 1 -- 172.21.15.57:0/3365300407 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v3) v1 ==== 74+0+1974 (secure 0 0 0) 0x7f4420034030 con 0x7f443006f4b0 2023-03-03T07:43:14.181 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-03T07:43:14.181 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":3,"fsid":"5022d617-ad40-4ad9-8d5b-120958296d9c","created":"2023-03-03T07:43:13.256676+0000","modified":"2023-03-03T07:43:13.786190+0000","last_up_change":"0.000000","last_in_change":"2023-03-03T07:43:13.786190+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":1,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d83f7ba7-9d9d-4309-95b9-2b8ad96f2f8b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T07:43:14.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:14.176+0000 7f44355f2700 1 -- 172.21.15.57:0/3365300407 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f443006f4b0 msgr2=0x7f443012dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:14.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:14.176+0000 7f44355f2700 1 --2- 172.21.15.57:0/3365300407 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f443006f4b0 0x7f443012dfc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4420014040 tx=0x7f4420004770 comp rx=0 tx=0).stop 2023-03-03T07:43:14.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:14.176+0000 7f44355f2700 1 -- 172.21.15.57:0/3365300407 shutdown_connections 2023-03-03T07:43:14.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:14.176+0000 7f44355f2700 1 --2- 172.21.15.57:0/3365300407 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f443006f4b0 0x7f443012dfc0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:14.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:14.176+0000 7f44355f2700 1 -- 172.21.15.57:0/3365300407 >> 172.21.15.57:0/3365300407 conn(0x7f4430069f00 msgr2=0x7f4430089f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:14.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:14.176+0000 7f44355f2700 1 -- 172.21.15.57:0/3365300407 shutdown_connections 2023-03-03T07:43:14.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:14.176+0000 7f44355f2700 1 -- 172.21.15.57:0/3365300407 wait complete. 2023-03-03T07:43:14.213 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-03-03T07:43:14.214 INFO:tasks.ceph:Waiting for OSDs to come up 2023-03-03T07:43:14.315 DEBUG:teuthology.orchestra.run.smithi057:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-03-03T07:43:14.348 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:43:14.340+0000 7fde7b2db2c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-03-03T07:43:14.453 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:43:14.448+0000 7fde7b2db2c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-03-03T07:43:14.491 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:14.484+0000 7fe6023e8700 1 Processor -- start 2023-03-03T07:43:14.492 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:14.488+0000 7fe6023e8700 1 -- start start 2023-03-03T07:43:14.494 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:14.488+0000 7fe6023e8700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe5fc124f70 0x7fe5fc123bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:14.494 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:14.488+0000 7fe6023e8700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5fc125480 con 0x7fe5fc124ba0 2023-03-03T07:43:14.494 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:14.488+0000 7fe6023e8700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5fc08c4a0 con 0x7fe5fc124f70 2023-03-03T07:43:14.495 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:14.488+0000 7fe6013e6700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fe5fc124ba0 0x7fe5fc1234e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:41968/0 (socket says 172.21.15.57:41968) 2023-03-03T07:43:14.495 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:14.488+0000 7fe6013e6700 1 -- 172.21.15.57:0/2765723093 learned_addr learned my addr 172.21.15.57:0/2765723093 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:43:14.495 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:14.488+0000 7fe600be5700 1 --2- 172.21.15.57:0/2765723093 >> v2:172.21.15.57:3300/0 conn(0x7fe5fc124f70 0x7fe5fc123bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:14.496 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:14.488+0000 7fe5effff700 1 -- 172.21.15.57:0/2765723093 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3186764510 0 0) 0x7fe5fc125480 con 0x7fe5fc124ba0 2023-03-03T07:43:14.496 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:14.488+0000 7fe5effff700 1 -- 172.21.15.57:0/2765723093 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5e80035d0 con 0x7fe5fc124ba0 2023-03-03T07:43:14.496 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:14.488+0000 7fe600be5700 1 -- 172.21.15.57:0/2765723093 >> v1:172.21.15.57:6789/0 conn(0x7fe5fc124ba0 legacy=0x7fe5fc1234e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:14.496 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:14.488+0000 7fe600be5700 1 -- 172.21.15.57:0/2765723093 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5fc070c40 con 0x7fe5fc124f70 2023-03-03T07:43:14.496 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:14.492+0000 7fe600be5700 1 --2- 172.21.15.57:0/2765723093 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5fc124f70 0x7fe5fc123bf0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe5f00097d0 tx=0x7fe5f0009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ebb935dbea2c8e2 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:14.497 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:14.492+0000 7fe5effff700 1 -- 172.21.15.57:0/2765723093 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe5f0004160 con 0x7fe5fc124f70 2023-03-03T07:43:14.497 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:14.492+0000 7fe5effff700 1 -- 172.21.15.57:0/2765723093 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f00042c0 con 0x7fe5fc124f70 2023-03-03T07:43:14.497 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:14.492+0000 7fe5effff700 1 -- 172.21.15.57:0/2765723093 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe5f00045a0 con 0x7fe5fc124f70 2023-03-03T07:43:14.498 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:14.492+0000 7fe6023e8700 1 -- 172.21.15.57:0/2765723093 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5fc124f70 msgr2=0x7fe5fc123bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:14.498 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:14.492+0000 7fe6023e8700 1 --2- 172.21.15.57:0/2765723093 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5fc124f70 0x7fe5fc123bf0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe5f00097d0 tx=0x7fe5f0009ae0 comp rx=0 tx=0).stop 2023-03-03T07:43:14.499 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:14.492+0000 7fe6023e8700 1 -- 172.21.15.57:0/2765723093 shutdown_connections 2023-03-03T07:43:14.499 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:14.492+0000 7fe6023e8700 1 --2- 172.21.15.57:0/2765723093 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5fc124f70 0x7fe5fc123bf0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:14.499 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:14.492+0000 7fe6023e8700 1 -- 172.21.15.57:0/2765723093 >> 172.21.15.57:0/2765723093 conn(0x7fe5fc06afa0 msgr2=0x7fe5fc06d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:14.500 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:14.492+0000 7fe6023e8700 1 -- 172.21.15.57:0/2765723093 shutdown_connections 2023-03-03T07:43:14.500 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:14.492+0000 7fe6023e8700 1 -- 172.21.15.57:0/2765723093 wait complete. 2023-03-03T07:43:14.501 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:14.496+0000 7fe6023e8700 1 Processor -- start 2023-03-03T07:43:14.502 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:14.496+0000 7fe6023e8700 1 -- start start 2023-03-03T07:43:14.503 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:14.496+0000 7fe6023e8700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5fc124ba0 0x7fe5fc1bbe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:14.503 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:14.496+0000 7fe6023e8700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5fc08cd30 con 0x7fe5fc124ba0 2023-03-03T07:43:14.503 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:14.496+0000 7fe6013e6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5fc124ba0 0x7fe5fc1bbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:14.504 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:14.496+0000 7fe6013e6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5fc124ba0 0x7fe5fc1bbe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50214/0 (socket says 172.21.15.57:50214) 2023-03-03T07:43:14.504 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:14.496+0000 7fe6013e6700 1 -- 172.21.15.57:0/1531459534 learned_addr learned my addr 172.21.15.57:0/1531459534 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:14.505 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:14.500+0000 7fe6013e6700 1 -- 172.21.15.57:0/1531459534 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f00094b0 con 0x7fe5fc124ba0 2023-03-03T07:43:14.505 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:14.500+0000 7fe6013e6700 1 --2- 172.21.15.57:0/1531459534 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5fc124ba0 0x7fe5fc1bbe90 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe5f800c680 tx=0x7fe5f800ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:14.506 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:14.500+0000 7fe5edffb700 1 -- 172.21.15.57:0/1531459534 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe5f8005cc0 con 0x7fe5fc124ba0 2023-03-03T07:43:14.506 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:14.500+0000 7fe5edffb700 1 -- 172.21.15.57:0/1531459534 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f8005e20 con 0x7fe5fc124ba0 2023-03-03T07:43:14.506 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:14.500+0000 7fe5edffb700 1 -- 172.21.15.57:0/1531459534 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe5f8007220 con 0x7fe5fc124ba0 2023-03-03T07:43:14.506 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:14.500+0000 7fe6023e8700 1 -- 172.21.15.57:0/1531459534 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5fc1242c0 con 0x7fe5fc124ba0 2023-03-03T07:43:14.507 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:14.500+0000 7fe6023e8700 1 -- 172.21.15.57:0/1531459534 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5fc124130 con 0x7fe5fc124ba0 2023-03-03T07:43:14.507 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:14.500+0000 7fe5edffb700 1 -- 172.21.15.57:0/1531459534 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fe5f8019030 con 0x7fe5fc124ba0 2023-03-03T07:43:14.507 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:14.500+0000 7fe5edffb700 1 -- 172.21.15.57:0/1531459534 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fe5f8012400 con 0x7fe5fc124ba0 2023-03-03T07:43:14.508 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:14.504+0000 7fe6023e8700 1 -- 172.21.15.57:0/1531459534 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5fc124450 con 0x7fe5fc124ba0 2023-03-03T07:43:14.512 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:14.504+0000 7fe5edffb700 1 -- 172.21.15.57:0/1531459534 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fe5f801ce60 con 0x7fe5fc124ba0 2023-03-03T07:43:14.581 INFO:tasks.ceph.osd.0.smithi057.stderr:2023-03-03T07:43:14.576+0000 7f237c94f700 -1 Falling back to public interface 2023-03-03T07:43:14.581 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:14.576+0000 7fe6023e8700 1 -- 172.21.15.57:0/1531459534 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5fc0619b0 con 0x7fe5fc124ba0 2023-03-03T07:43:14.582 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:14.576+0000 7fe5edffb700 1 -- 172.21.15.57:0/1531459534 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v3) v1 ==== 74+0+1974 (secure 0 0 0) 0x7fe5f8017070 con 0x7fe5fc124ba0 2023-03-03T07:43:14.583 INFO:teuthology.misc.health.smithi057.stdout: 2023-03-03T07:43:14.583 INFO:teuthology.misc.health.smithi057.stdout:{"epoch":3,"fsid":"5022d617-ad40-4ad9-8d5b-120958296d9c","created":"2023-03-03T07:43:13.256676+0000","modified":"2023-03-03T07:43:13.786190+0000","last_up_change":"0.000000","last_in_change":"2023-03-03T07:43:13.786190+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":1,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d83f7ba7-9d9d-4309-95b9-2b8ad96f2f8b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T07:43:14.588 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:14.580+0000 7fe6023e8700 1 -- 172.21.15.57:0/1531459534 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5fc124ba0 msgr2=0x7fe5fc1bbe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:14.588 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:14.580+0000 7fe6023e8700 1 --2- 172.21.15.57:0/1531459534 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5fc124ba0 0x7fe5fc1bbe90 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe5f800c680 tx=0x7fe5f800ca40 comp rx=0 tx=0).stop 2023-03-03T07:43:14.588 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:14.580+0000 7fe6023e8700 1 -- 172.21.15.57:0/1531459534 shutdown_connections 2023-03-03T07:43:14.588 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:14.580+0000 7fe6023e8700 1 --2- 172.21.15.57:0/1531459534 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5fc124ba0 0x7fe5fc1bbe90 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:14.588 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:14.580+0000 7fe6023e8700 1 -- 172.21.15.57:0/1531459534 >> 172.21.15.57:0/1531459534 conn(0x7fe5fc06afa0 msgr2=0x7fe5fc08a0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:14.589 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:14.580+0000 7fe6023e8700 1 -- 172.21.15.57:0/1531459534 shutdown_connections 2023-03-03T07:43:14.589 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:14.580+0000 7fe6023e8700 1 -- 172.21.15.57:0/1531459534 wait complete. 2023-03-03T07:43:14.612 DEBUG:teuthology.misc:0 of 1 OSDs are up 2023-03-03T07:43:14.629 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:43:14.624+0000 7fde7b2db2c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-03-03T07:43:14.990 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:43:14.984+0000 7fde7b2db2c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-03-03T07:43:15.089 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:43:15.084+0000 7fde7b2db2c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-03-03T07:43:15.379 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:43:15.372+0000 7fde7b2db2c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-03-03T07:43:15.493 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:43:15.488+0000 7fde7b2db2c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-03-03T07:43:15.617 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:43:15.612+0000 7fde7b2db2c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-03-03T07:43:16.170 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:43:16.164+0000 7fde7b2db2c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-03-03T07:43:16.398 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:43:16.392+0000 7fde7b2db2c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-03-03T07:43:17.213 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:43:17.208+0000 7fde7b2db2c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-03-03T07:43:17.507 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:43:17.500+0000 7fde7b2db2c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-03-03T07:43:17.756 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:43:17.752+0000 7fde7b2db2c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-03-03T07:43:17.874 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:43:17.868+0000 7fde7b2db2c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-03-03T07:43:18.643 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:43:18.636+0000 7fde7b2db2c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-03-03T07:43:18.787 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:43:18.780+0000 7fde7b2db2c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-03-03T07:43:18.823 INFO:tasks.ceph.osd.0.smithi057.stderr:2023-03-03T07:43:18.816+0000 7f237c94f700 -1 osd.0 0 log_to_monitors true 2023-03-03T07:43:19.007 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:43:19.000+0000 7fde7b2db2c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-03-03T07:43:19.132 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:43:19.124+0000 7fde7b2db2c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-03-03T07:43:19.446 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:43:19.440+0000 7fde7b2db2c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-03-03T07:43:19.712 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:43:19.704+0000 7fde7b2db2c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-03-03T07:43:19.850 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:43:19.844+0000 7fde7b2db2c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-03-03T07:43:20.715 DEBUG:teuthology.orchestra.run.smithi057:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-03-03T07:43:20.733 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:43:20.728+0000 7fde7b2db2c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-03-03T07:43:20.911 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:20.904+0000 7f961759e700 1 Processor -- start 2023-03-03T07:43:20.912 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:20.904+0000 7f961759e700 1 -- start start 2023-03-03T07:43:20.913 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:20.908+0000 7f961759e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f961809adb0 0x7f961808e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:20.913 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:20.908+0000 7f961759e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9618090ec0 con 0x7f961808ed90 2023-03-03T07:43:20.914 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:20.908+0000 7f961759e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96180904e0 con 0x7f961809adb0 2023-03-03T07:43:20.914 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:20.908+0000 7f961659c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f961809adb0 0x7f961808e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:20.914 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:20.908+0000 7f9615d9b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f961808ed90 0x7f961812c4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54438/0 (socket says 172.21.15.57:54438) 2023-03-03T07:43:20.914 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:20.908+0000 7f9615d9b700 1 -- 172.21.15.57:0/2861673168 learned_addr learned my addr 172.21.15.57:0/2861673168 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:43:20.915 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:20.908+0000 7f961659c700 1 -- 172.21.15.57:0/2861673168 >> v1:172.21.15.57:6789/0 conn(0x7f961808ed90 legacy=0x7f961812c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:20.915 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:20.908+0000 7f961659c700 1 -- 172.21.15.57:0/2861673168 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f961809b180 con 0x7f961809adb0 2023-03-03T07:43:20.916 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:20.908+0000 7f961659c700 1 --2- 172.21.15.57:0/2861673168 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f961809adb0 0x7f961808e850 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f96080097d0 tx=0x7f9608009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44c8280f4e5c8e7c server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:20.916 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:20.908+0000 7f961559a700 1 -- 172.21.15.57:0/2861673168 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f96080041c0 con 0x7f961809adb0 2023-03-03T07:43:20.916 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:20.912+0000 7f961559a700 1 -- 172.21.15.57:0/2861673168 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9608004320 con 0x7f961809adb0 2023-03-03T07:43:20.916 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:20.912+0000 7f961559a700 1 -- 172.21.15.57:0/2861673168 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f96080036c0 con 0x7f961809adb0 2023-03-03T07:43:20.917 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:20.912+0000 7f961759e700 1 -- 172.21.15.57:0/2861673168 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f961809adb0 msgr2=0x7f961808e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:20.917 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:20.912+0000 7f961759e700 1 --2- 172.21.15.57:0/2861673168 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f961809adb0 0x7f961808e850 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f96080097d0 tx=0x7f9608009ae0 comp rx=0 tx=0).stop 2023-03-03T07:43:20.918 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:20.912+0000 7f961759e700 1 -- 172.21.15.57:0/2861673168 shutdown_connections 2023-03-03T07:43:20.918 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:20.912+0000 7f961759e700 1 --2- 172.21.15.57:0/2861673168 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f961809adb0 0x7f961808e850 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:20.919 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:20.912+0000 7f961759e700 1 -- 172.21.15.57:0/2861673168 >> 172.21.15.57:0/2861673168 conn(0x7f961806d820 msgr2=0x7f961806fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:20.919 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:20.912+0000 7f961759e700 1 -- 172.21.15.57:0/2861673168 shutdown_connections 2023-03-03T07:43:20.919 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:20.912+0000 7f961759e700 1 -- 172.21.15.57:0/2861673168 wait complete. 2023-03-03T07:43:20.921 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:20.916+0000 7f961759e700 1 Processor -- start 2023-03-03T07:43:20.922 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:20.916+0000 7f961759e700 1 -- start start 2023-03-03T07:43:20.923 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:20.916+0000 7f961759e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f961808ed90 0x7f96181bac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:20.923 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:20.916+0000 7f961759e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96181a7980 con 0x7f961808ed90 2023-03-03T07:43:20.923 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:20.916+0000 7f961659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f961808ed90 0x7f96181bac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:20.924 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:20.916+0000 7f961659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f961808ed90 0x7f96181bac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60652/0 (socket says 172.21.15.57:60652) 2023-03-03T07:43:20.924 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:20.916+0000 7f961659c700 1 -- 172.21.15.57:0/120812253 learned_addr learned my addr 172.21.15.57:0/120812253 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:20.924 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:20.920+0000 7f961659c700 1 -- 172.21.15.57:0/120812253 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96080094b0 con 0x7f961808ed90 2023-03-03T07:43:20.925 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:20.920+0000 7f961659c700 1 --2- 172.21.15.57:0/120812253 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f961808ed90 0x7f96181bac30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9608009b20 tx=0x7f9608004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:20.925 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:20.920+0000 7f9606ffd700 1 -- 172.21.15.57:0/120812253 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9608006ea0 con 0x7f961808ed90 2023-03-03T07:43:20.925 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:20.920+0000 7f9606ffd700 1 -- 172.21.15.57:0/120812253 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9608011630 con 0x7f961808ed90 2023-03-03T07:43:20.926 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:20.920+0000 7f9606ffd700 1 -- 172.21.15.57:0/120812253 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f96080118d0 con 0x7f961808ed90 2023-03-03T07:43:20.926 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:20.920+0000 7f961759e700 1 -- 172.21.15.57:0/120812253 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f961808fe10 con 0x7f961808ed90 2023-03-03T07:43:20.926 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:20.920+0000 7f961759e700 1 -- 172.21.15.57:0/120812253 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f961808fc80 con 0x7f961808ed90 2023-03-03T07:43:20.927 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:20.920+0000 7f9606ffd700 1 -- 172.21.15.57:0/120812253 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 2) v1 ==== 41975+0+0 (secure 0 0 0) 0x7f960800f050 con 0x7f961808ed90 2023-03-03T07:43:20.927 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:20.920+0000 7f961759e700 1 -- 172.21.15.57:0/120812253 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f961808f230 con 0x7f961808ed90 2023-03-03T07:43:20.928 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:20.924+0000 7f9606ffd700 1 -- 172.21.15.57:0/120812253 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1057+0+0 (secure 0 0 0) 0x7f96080469c0 con 0x7f961808ed90 2023-03-03T07:43:20.933 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:20.928+0000 7f9606ffd700 1 -- 172.21.15.57:0/120812253 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f960800b740 con 0x7f961808ed90 2023-03-03T07:43:21.024 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:21.016+0000 7f961759e700 1 -- 172.21.15.57:0/120812253 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f96181a7ac0 con 0x7f961808ed90 2023-03-03T07:43:21.025 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:21.020+0000 7f9606ffd700 1 -- 172.21.15.57:0/120812253 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v5) v1 ==== 74+0+1974 (secure 0 0 0) 0x7f96181a7ac0 con 0x7f961808ed90 2023-03-03T07:43:21.025 INFO:teuthology.misc.health.smithi057.stdout: 2023-03-03T07:43:21.026 INFO:teuthology.misc.health.smithi057.stdout:{"epoch":5,"fsid":"5022d617-ad40-4ad9-8d5b-120958296d9c","created":"2023-03-03T07:43:13.256676+0000","modified":"2023-03-03T07:43:20.257885+0000","last_up_change":"0.000000","last_in_change":"2023-03-03T07:43:13.786190+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":1,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d83f7ba7-9d9d-4309-95b9-2b8ad96f2f8b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T07:43:21.026 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:21.020+0000 7f961759e700 1 -- 172.21.15.57:0/120812253 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f961808ed90 msgr2=0x7f96181bac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:21.026 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:21.020+0000 7f961759e700 1 --2- 172.21.15.57:0/120812253 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f961808ed90 0x7f96181bac30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9608009b20 tx=0x7f9608004770 comp rx=0 tx=0).stop 2023-03-03T07:43:21.027 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:21.020+0000 7f961759e700 1 -- 172.21.15.57:0/120812253 shutdown_connections 2023-03-03T07:43:21.027 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:21.020+0000 7f961759e700 1 --2- 172.21.15.57:0/120812253 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f961808ed90 0x7f96181bac30 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:21.027 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:21.020+0000 7f961759e700 1 -- 172.21.15.57:0/120812253 >> 172.21.15.57:0/120812253 conn(0x7f961806d820 msgr2=0x7f96180704a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:21.027 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:21.020+0000 7f961759e700 1 -- 172.21.15.57:0/120812253 shutdown_connections 2023-03-03T07:43:21.027 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:21.020+0000 7f961759e700 1 -- 172.21.15.57:0/120812253 wait complete. 2023-03-03T07:43:21.065 DEBUG:teuthology.misc:0 of 1 OSDs are up 2023-03-03T07:43:21.721 INFO:tasks.ceph.osd.0.smithi057.stderr:2023-03-03T07:43:21.716+0000 7f2379916700 -1 osd.0 0 waiting for initial osdmap 2023-03-03T07:43:21.733 INFO:tasks.ceph.osd.0.smithi057.stderr:2023-03-03T07:43:21.728+0000 7f23701f1700 -1 osd.0 5 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-03T07:43:21.754 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:43:21.748+0000 7fde61b03700 -1 mgr.server handle_report got status from non-daemon mon.a 2023-03-03T07:43:27.167 DEBUG:teuthology.orchestra.run.smithi057:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-03-03T07:43:27.368 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:27.364+0000 7fddd8a66700 1 Processor -- start 2023-03-03T07:43:27.369 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:27.364+0000 7fddd8a66700 1 -- start start 2023-03-03T07:43:27.370 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:27.364+0000 7fddd8a66700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fddd4126b10 0x7fddd4126ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:27.370 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:27.364+0000 7fddd8a66700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddd4090b60 con 0x7fddd4125590 2023-03-03T07:43:27.370 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:27.364+0000 7fddd8a66700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddd4090e70 con 0x7fddd4126b10 2023-03-03T07:43:27.371 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:27.364+0000 7fddd37fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fddd4126b10 0x7fddd4126ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:27.371 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:27.364+0000 7fddcbfff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fddd4125590 0x7fddd4125a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54444/0 (socket says 172.21.15.57:54444) 2023-03-03T07:43:27.371 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:27.364+0000 7fddcbfff700 1 -- 172.21.15.57:0/1881353206 learned_addr learned my addr 172.21.15.57:0/1881353206 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:43:27.372 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:27.368+0000 7fddd2ffd700 1 -- 172.21.15.57:0/1881353206 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2544970194 0 0) 0x7fddd4090b60 con 0x7fddd4125590 2023-03-03T07:43:27.372 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:27.368+0000 7fddd2ffd700 1 -- 172.21.15.57:0/1881353206 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddc00035d0 con 0x7fddd4125590 2023-03-03T07:43:27.372 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:27.368+0000 7fddd37fe700 1 -- 172.21.15.57:0/1881353206 >> v1:172.21.15.57:6789/0 conn(0x7fddd4125590 legacy=0x7fddd4125a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:27.373 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:27.368+0000 7fddd37fe700 1 -- 172.21.15.57:0/1881353206 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd4127420 con 0x7fddd4126b10 2023-03-03T07:43:27.373 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:27.368+0000 7fddd37fe700 1 --2- 172.21.15.57:0/1881353206 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddd4126b10 0x7fddd4126ee0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fddc40097d0 tx=0x7fddc4009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a45675d3bf62d22 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:27.374 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:27.368+0000 7fddd2ffd700 1 -- 172.21.15.57:0/1881353206 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fddc4004160 con 0x7fddd4126b10 2023-03-03T07:43:27.374 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:27.368+0000 7fddd2ffd700 1 -- 172.21.15.57:0/1881353206 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc40042c0 con 0x7fddd4126b10 2023-03-03T07:43:27.374 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:27.368+0000 7fddd2ffd700 1 -- 172.21.15.57:0/1881353206 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fddc40045a0 con 0x7fddd4126b10 2023-03-03T07:43:27.375 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:27.368+0000 7fddd8a66700 1 -- 172.21.15.57:0/1881353206 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddd4126b10 msgr2=0x7fddd4126ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:27.375 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:27.368+0000 7fddd8a66700 1 --2- 172.21.15.57:0/1881353206 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddd4126b10 0x7fddd4126ee0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fddc40097d0 tx=0x7fddc4009ae0 comp rx=0 tx=0).stop 2023-03-03T07:43:27.375 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:27.368+0000 7fddd8a66700 1 -- 172.21.15.57:0/1881353206 shutdown_connections 2023-03-03T07:43:27.375 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:27.368+0000 7fddd8a66700 1 --2- 172.21.15.57:0/1881353206 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddd4126b10 0x7fddd4126ee0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:27.376 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:27.368+0000 7fddd8a66700 1 -- 172.21.15.57:0/1881353206 >> 172.21.15.57:0/1881353206 conn(0x7fddd406d860 msgr2=0x7fddd406fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:27.376 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:27.368+0000 7fddd8a66700 1 -- 172.21.15.57:0/1881353206 shutdown_connections 2023-03-03T07:43:27.376 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:27.368+0000 7fddd8a66700 1 -- 172.21.15.57:0/1881353206 wait complete. 2023-03-03T07:43:27.377 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:27.372+0000 7fddd8a66700 1 Processor -- start 2023-03-03T07:43:27.378 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:27.372+0000 7fddd8a66700 1 -- start start 2023-03-03T07:43:27.379 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:27.372+0000 7fddd8a66700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddd4125590 0x7fddd4093430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:27.379 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:27.372+0000 7fddd8a66700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd4095ab0 con 0x7fddd4125590 2023-03-03T07:43:27.379 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:27.372+0000 7fddd37fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddd4125590 0x7fddd4093430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:27.380 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:27.372+0000 7fddd37fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddd4125590 0x7fddd4093430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60686/0 (socket says 172.21.15.57:60686) 2023-03-03T07:43:27.380 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:27.372+0000 7fddd37fe700 1 -- 172.21.15.57:0/199826511 learned_addr learned my addr 172.21.15.57:0/199826511 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:27.380 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:27.376+0000 7fddd37fe700 1 -- 172.21.15.57:0/199826511 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc40094b0 con 0x7fddd4125590 2023-03-03T07:43:27.381 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:27.376+0000 7fddd37fe700 1 --2- 172.21.15.57:0/199826511 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddd4125590 0x7fddd4093430 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fddc40090b0 tx=0x7fddc4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:27.382 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:27.376+0000 7fddd0ff9700 1 -- 172.21.15.57:0/199826511 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fddc4003c80 con 0x7fddd4125590 2023-03-03T07:43:27.382 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:27.376+0000 7fddd0ff9700 1 -- 172.21.15.57:0/199826511 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc401f070 con 0x7fddd4125590 2023-03-03T07:43:27.383 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:27.376+0000 7fddd0ff9700 1 -- 172.21.15.57:0/199826511 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fddc4011630 con 0x7fddd4125590 2023-03-03T07:43:27.383 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:27.376+0000 7fddd8a66700 1 -- 172.21.15.57:0/199826511 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddd41262b0 con 0x7fddd4125590 2023-03-03T07:43:27.383 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:27.376+0000 7fddd8a66700 1 -- 172.21.15.57:0/199826511 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddd4126120 con 0x7fddd4125590 2023-03-03T07:43:27.384 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:27.380+0000 7fddd0ff9700 1 -- 172.21.15.57:0/199826511 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42205+0+0 (secure 0 0 0) 0x7fddc402a020 con 0x7fddd4125590 2023-03-03T07:43:27.385 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:27.380+0000 7fddd8a66700 1 -- 172.21.15.57:0/199826511 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddd4126440 con 0x7fddd4125590 2023-03-03T07:43:27.385 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:27.380+0000 7fddd0ff9700 1 --2- 172.21.15.57:0/199826511 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fddb4034880 0x7fddb4036d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:27.386 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:27.380+0000 7fddd0ff9700 1 -- 172.21.15.57:0/199826511 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1723+0+0 (secure 0 0 0) 0x7fddc4047330 con 0x7fddd4125590 2023-03-03T07:43:27.386 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:27.380+0000 7fddcbfff700 1 --2- 172.21.15.57:0/199826511 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fddb4034880 0x7fddb4036d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:27.387 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:27.380+0000 7fddcbfff700 1 --2- 172.21.15.57:0/199826511 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fddb4034880 0x7fddb4036d30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fddbc0016d0 tx=0x7fddbc007a20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:27.396 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:27.392+0000 7fddd0ff9700 1 -- 172.21.15.57:0/199826511 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fddc4011790 con 0x7fddd4125590 2023-03-03T07:43:27.577 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:27.572+0000 7fddd8a66700 1 -- 172.21.15.57:0/199826511 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fddd40619b0 con 0x7fddd4125590 2023-03-03T07:43:27.578 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:27.572+0000 7fddd0ff9700 1 -- 172.21.15.57:0/199826511 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v9) v1 ==== 74+0+4186 (secure 0 0 0) 0x7fddc4033070 con 0x7fddd4125590 2023-03-03T07:43:27.579 INFO:teuthology.misc.health.smithi057.stdout: 2023-03-03T07:43:27.579 INFO:teuthology.misc.health.smithi057.stdout:{"epoch":9,"fsid":"5022d617-ad40-4ad9-8d5b-120958296d9c","created":"2023-03-03T07:43:13.256676+0000","modified":"2023-03-03T07:43:25.763409+0000","last_up_change":"2023-03-03T07:43:22.721740+0000","last_in_change":"2023-03-03T07:43:13.786190+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":1,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-03T07:43:22.864508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":1,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"9","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":1,"score_stable":1,"optimal_score":1,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d83f7ba7-9d9d-4309-95b9-2b8ad96f2f8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":6,"up_thru":7,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":28687},{"type":"v1","addr":"172.21.15.57:6801","nonce":28687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":28687},{"type":"v1","addr":"172.21.15.57:6803","nonce":28687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":28687},{"type":"v1","addr":"172.21.15.57:6807","nonce":28687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":28687},{"type":"v1","addr":"172.21.15.57:6805","nonce":28687}]},"public_addr":"172.21.15.57:6801/28687","cluster_addr":"172.21.15.57:6803/28687","heartbeat_back_addr":"172.21.15.57:6807/28687","heartbeat_front_addr":"172.21.15.57:6805/28687","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T07:43:19.859898+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T07:43:27.581 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:27.576+0000 7fddd8a66700 1 -- 172.21.15.57:0/199826511 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fddb4034880 msgr2=0x7fddb4036d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:27.581 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:27.576+0000 7fddd8a66700 1 --2- 172.21.15.57:0/199826511 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fddb4034880 0x7fddb4036d30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fddbc0016d0 tx=0x7fddbc007a20 comp rx=0 tx=0).stop 2023-03-03T07:43:27.582 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:27.576+0000 7fddd8a66700 1 -- 172.21.15.57:0/199826511 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddd4125590 msgr2=0x7fddd4093430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:27.582 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:27.576+0000 7fddd8a66700 1 --2- 172.21.15.57:0/199826511 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddd4125590 0x7fddd4093430 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fddc40090b0 tx=0x7fddc4004770 comp rx=0 tx=0).stop 2023-03-03T07:43:27.582 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:27.576+0000 7fddd8a66700 1 -- 172.21.15.57:0/199826511 shutdown_connections 2023-03-03T07:43:27.582 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:27.576+0000 7fddd8a66700 1 --2- 172.21.15.57:0/199826511 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fddb4034880 0x7fddb4036d30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:27.582 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:27.576+0000 7fddd8a66700 1 --2- 172.21.15.57:0/199826511 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddd4125590 0x7fddd4093430 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:27.583 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:27.576+0000 7fddd8a66700 1 -- 172.21.15.57:0/199826511 >> 172.21.15.57:0/199826511 conn(0x7fddd406d860 msgr2=0x7fddd406ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:27.583 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:27.576+0000 7fddd8a66700 1 -- 172.21.15.57:0/199826511 shutdown_connections 2023-03-03T07:43:27.583 INFO:teuthology.misc.health.smithi057.stderr:2023-03-03T07:43:27.576+0000 7fddd8a66700 1 -- 172.21.15.57:0/199826511 wait complete. 2023-03-03T07:43:27.610 DEBUG:teuthology.misc:1 of 1 OSDs are up 2023-03-03T07:43:27.611 INFO:tasks.ceph:Creating RBD pool 2023-03-03T07:43:27.612 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph osd pool create rbd 8 2023-03-03T07:43:27.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:27.796+0000 7fcf1db56700 1 Processor -- start 2023-03-03T07:43:27.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:27.796+0000 7fcf1db56700 1 -- start start 2023-03-03T07:43:27.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:27.796+0000 7fcf1db56700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcf18124960 0x7fcf18124d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:27.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:27.796+0000 7fcf1db56700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf1808d260 con 0x7fcf1808bd50 2023-03-03T07:43:27.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:27.796+0000 7fcf1db56700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf1808d490 con 0x7fcf18124960 2023-03-03T07:43:27.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:27.796+0000 7fcf1cb54700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcf18124960 0x7fcf18124d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:27.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:27.796+0000 7fcf1cb54700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcf18124960 0x7fcf18124d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60694/0 (socket says 172.21.15.57:60694) 2023-03-03T07:43:27.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:27.796+0000 7fcf1cb54700 1 -- 172.21.15.57:0/1795627605 learned_addr learned my addr 172.21.15.57:0/1795627605 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:27.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:27.796+0000 7fcf0ffff700 1 --1- 172.21.15.57:0/1795627605 >> v1:172.21.15.57:6789/0 conn(0x7fcf1808bd50 0x7fcf1808c1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54446/0 (socket says 172.21.15.57:54446) 2023-03-03T07:43:27.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:27.800+0000 7fcf1cb54700 1 -- 172.21.15.57:0/1795627605 >> v1:172.21.15.57:6789/0 conn(0x7fcf1808bd50 legacy=0x7fcf1808c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T07:43:27.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:27.800+0000 7fcf1cb54700 1 -- 172.21.15.57:0/1795627605 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf18125270 con 0x7fcf18124960 2023-03-03T07:43:27.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:27.800+0000 7fcf1cb54700 1 --2- 172.21.15.57:0/1795627605 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf18124960 0x7fcf18124d30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcf14009890 tx=0x7fcf14009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=692a847228125312 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:27.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:27.800+0000 7fcf0f7fe700 1 -- 172.21.15.57:0/1795627605 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcf14004160 con 0x7fcf18124960 2023-03-03T07:43:27.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:27.800+0000 7fcf0f7fe700 1 -- 172.21.15.57:0/1795627605 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf140042c0 con 0x7fcf18124960 2023-03-03T07:43:27.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:27.800+0000 7fcf0f7fe700 1 -- 172.21.15.57:0/1795627605 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcf14004580 con 0x7fcf18124960 2023-03-03T07:43:27.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:27.800+0000 7fcf1db56700 1 -- 172.21.15.57:0/1795627605 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf18124960 msgr2=0x7fcf18124d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:27.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:27.800+0000 7fcf1db56700 1 --2- 172.21.15.57:0/1795627605 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf18124960 0x7fcf18124d30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcf14009890 tx=0x7fcf14009ba0 comp rx=0 tx=0).stop 2023-03-03T07:43:27.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:27.800+0000 7fcf1db56700 1 -- 172.21.15.57:0/1795627605 shutdown_connections 2023-03-03T07:43:27.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:27.800+0000 7fcf1db56700 1 --2- 172.21.15.57:0/1795627605 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf18124960 0x7fcf18124d30 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:27.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:27.800+0000 7fcf1db56700 1 -- 172.21.15.57:0/1795627605 >> 172.21.15.57:0/1795627605 conn(0x7fcf1806da50 msgr2=0x7fcf1806fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:27.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:27.800+0000 7fcf1db56700 1 -- 172.21.15.57:0/1795627605 shutdown_connections 2023-03-03T07:43:27.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:27.800+0000 7fcf1db56700 1 -- 172.21.15.57:0/1795627605 wait complete. 2023-03-03T07:43:27.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:27.804+0000 7fcf1db56700 1 Processor -- start 2023-03-03T07:43:27.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:27.804+0000 7fcf1db56700 1 -- start start 2023-03-03T07:43:27.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:27.804+0000 7fcf1db56700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf1808bd50 0x7fcf18096300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:27.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:27.804+0000 7fcf1db56700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1806f9a0 con 0x7fcf1808bd50 2023-03-03T07:43:27.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:27.804+0000 7fcf1cb54700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf1808bd50 0x7fcf18096300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:27.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:27.804+0000 7fcf1cb54700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf1808bd50 0x7fcf18096300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60698/0 (socket says 172.21.15.57:60698) 2023-03-03T07:43:27.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:27.804+0000 7fcf1cb54700 1 -- 172.21.15.57:0/1734112713 learned_addr learned my addr 172.21.15.57:0/1734112713 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:27.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:27.808+0000 7fcf1cb54700 1 -- 172.21.15.57:0/1734112713 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf14009520 con 0x7fcf1808bd50 2023-03-03T07:43:27.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:27.808+0000 7fcf1cb54700 1 --2- 172.21.15.57:0/1734112713 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf1808bd50 0x7fcf18096300 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fcf14009130 tx=0x7fcf14004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:27.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:27.808+0000 7fcf0d7fa700 1 -- 172.21.15.57:0/1734112713 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcf14003d10 con 0x7fcf1808bd50 2023-03-03T07:43:27.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:27.808+0000 7fcf0d7fa700 1 -- 172.21.15.57:0/1734112713 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1401f070 con 0x7fcf1808bd50 2023-03-03T07:43:27.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:27.808+0000 7fcf0d7fa700 1 -- 172.21.15.57:0/1734112713 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcf14011630 con 0x7fcf1808bd50 2023-03-03T07:43:27.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:27.808+0000 7fcf1db56700 1 -- 172.21.15.57:0/1734112713 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf1808c8c0 con 0x7fcf1808bd50 2023-03-03T07:43:27.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:27.808+0000 7fcf1db56700 1 -- 172.21.15.57:0/1734112713 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf18124410 con 0x7fcf1808bd50 2023-03-03T07:43:27.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:27.812+0000 7fcf1db56700 1 -- 172.21.15.57:0/1734112713 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf1808ca50 con 0x7fcf1808bd50 2023-03-03T07:43:27.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:27.812+0000 7fcf0d7fa700 1 -- 172.21.15.57:0/1734112713 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42205+0+0 (secure 0 0 0) 0x7fcf14017020 con 0x7fcf1808bd50 2023-03-03T07:43:27.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:27.812+0000 7fcf0d7fa700 1 --2- 172.21.15.57:0/1734112713 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fcf04034830 0x7fcf04036ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:27.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:27.812+0000 7fcf0d7fa700 1 -- 172.21.15.57:0/1734112713 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1723+0+0 (secure 0 0 0) 0x7fcf14047530 con 0x7fcf1808bd50 2023-03-03T07:43:27.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:27.812+0000 7fcf0ffff700 1 --2- 172.21.15.57:0/1734112713 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fcf04034830 0x7fcf04036ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:27.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:27.812+0000 7fcf0ffff700 1 --2- 172.21.15.57:0/1734112713 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fcf04034830 0x7fcf04036ce0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fcf08000c00 tx=0x7fcf08007af0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:27.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:27.816+0000 7fcf0d7fa700 1 -- 172.21.15.57:0/1734112713 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fcf1402c990 con 0x7fcf1808bd50 2023-03-03T07:43:28.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:27.996+0000 7fcf1db56700 1 -- 172.21.15.57:0/1734112713 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fcf180619b0 con 0x7fcf1808bd50 2023-03-03T07:43:28.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:28.800+0000 7fcf0d7fa700 1 -- 172.21.15.57:0/1734112713 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v10) v1 ==== 109+0+0 (secure 0 0 0) 0x7fcf1402c3a0 con 0x7fcf1808bd50 2023-03-03T07:43:28.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:28.808+0000 7fcf1db56700 1 -- 172.21.15.57:0/1734112713 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fcf04034830 msgr2=0x7fcf04036ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:28.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:28.808+0000 7fcf1db56700 1 --2- 172.21.15.57:0/1734112713 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fcf04034830 0x7fcf04036ce0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fcf08000c00 tx=0x7fcf08007af0 comp rx=0 tx=0).stop 2023-03-03T07:43:28.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:28.808+0000 7fcf1db56700 1 -- 172.21.15.57:0/1734112713 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf1808bd50 msgr2=0x7fcf18096300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:28.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:28.808+0000 7fcf1db56700 1 --2- 172.21.15.57:0/1734112713 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf1808bd50 0x7fcf18096300 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fcf14009130 tx=0x7fcf14004770 comp rx=0 tx=0).stop 2023-03-03T07:43:28.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:28.808+0000 7fcf1db56700 1 -- 172.21.15.57:0/1734112713 shutdown_connections 2023-03-03T07:43:28.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:28.808+0000 7fcf1db56700 1 --2- 172.21.15.57:0/1734112713 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fcf04034830 0x7fcf04036ce0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:28.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:28.808+0000 7fcf1db56700 1 --2- 172.21.15.57:0/1734112713 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf1808bd50 0x7fcf18096300 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:28.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:28.808+0000 7fcf1db56700 1 -- 172.21.15.57:0/1734112713 >> 172.21.15.57:0/1734112713 conn(0x7fcf1806da50 msgr2=0x7fcf1808ad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:28.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:28.808+0000 7fcf1db56700 1 -- 172.21.15.57:0/1734112713 shutdown_connections 2023-03-03T07:43:28.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:28.808+0000 7fcf1db56700 1 -- 172.21.15.57:0/1734112713 wait complete. 2023-03-03T07:43:28.818 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'rbd' created 2023-03-03T07:43:28.847 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-03-03T07:43:29.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:29.044+0000 7fe8b62c4700 1 Processor -- start 2023-03-03T07:43:29.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:29.044+0000 7fe8b62c4700 1 -- start start 2023-03-03T07:43:29.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:29.048+0000 7fe8b62c4700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe8b0124560 0x7fe8b0124930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:29.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:29.048+0000 7fe8b62c4700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8b008d4f0 con 0x7fe8b008a5b0 2023-03-03T07:43:29.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:29.048+0000 7fe8b62c4700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8b0072d70 con 0x7fe8b0124560 2023-03-03T07:43:29.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:29.048+0000 7fe8b52c2700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe8b0124560 0x7fe8b0124930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:29.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:29.048+0000 7fe8b4ac1700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fe8b008a5b0 0x7fe8b008aa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54458/0 (socket says 172.21.15.57:54458) 2023-03-03T07:43:29.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:29.048+0000 7fe8b4ac1700 1 -- 172.21.15.57:0/3852228353 learned_addr learned my addr 172.21.15.57:0/3852228353 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:43:29.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:29.048+0000 7fe8b52c2700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe8b0124560 0x7fe8b0124930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60710/0 (socket says 172.21.15.57:60710) 2023-03-03T07:43:29.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:29.048+0000 7fe8b52c2700 1 -- 172.21.15.57:0/3852228353 >> v1:172.21.15.57:6789/0 conn(0x7fe8b008a5b0 legacy=0x7fe8b008aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:29.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:29.048+0000 7fe8b52c2700 1 -- 172.21.15.57:0/3852228353 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b0124e70 con 0x7fe8b0124560 2023-03-03T07:43:29.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:29.048+0000 7fe8b52c2700 1 --2- 172.21.15.57:0/3852228353 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8b0124560 0x7fe8b0124930 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac0097d0 tx=0x7fe8ac009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fda68b3b8b724d4 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:29.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:29.048+0000 7fe8a7fff700 1 -- 172.21.15.57:0/3852228353 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe8ac0041c0 con 0x7fe8b0124560 2023-03-03T07:43:29.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:29.052+0000 7fe8a7fff700 1 -- 172.21.15.57:0/3852228353 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8ac004320 con 0x7fe8b0124560 2023-03-03T07:43:29.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:29.052+0000 7fe8a7fff700 1 -- 172.21.15.57:0/3852228353 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe8ac0036c0 con 0x7fe8b0124560 2023-03-03T07:43:29.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:29.052+0000 7fe8b62c4700 1 -- 172.21.15.57:0/3852228353 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8b0124560 msgr2=0x7fe8b0124930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:29.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:29.052+0000 7fe8b62c4700 1 --2- 172.21.15.57:0/3852228353 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8b0124560 0x7fe8b0124930 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac0097d0 tx=0x7fe8ac009ae0 comp rx=0 tx=0).stop 2023-03-03T07:43:29.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:29.052+0000 7fe8b62c4700 1 -- 172.21.15.57:0/3852228353 shutdown_connections 2023-03-03T07:43:29.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:29.052+0000 7fe8b62c4700 1 --2- 172.21.15.57:0/3852228353 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8b0124560 0x7fe8b0124930 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:29.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:29.052+0000 7fe8b62c4700 1 -- 172.21.15.57:0/3852228353 >> 172.21.15.57:0/3852228353 conn(0x7fe8b006dc90 msgr2=0x7fe8b0070070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:29.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:29.052+0000 7fe8b62c4700 1 -- 172.21.15.57:0/3852228353 shutdown_connections 2023-03-03T07:43:29.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:29.052+0000 7fe8b62c4700 1 -- 172.21.15.57:0/3852228353 wait complete. 2023-03-03T07:43:29.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:29.052+0000 7fe8b62c4700 1 Processor -- start 2023-03-03T07:43:29.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:29.056+0000 7fe8b62c4700 1 -- start start 2023-03-03T07:43:29.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:29.056+0000 7fe8b62c4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8b008a5b0 0x7fe8b0093240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:29.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:29.056+0000 7fe8b62c4700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b0095de0 con 0x7fe8b008a5b0 2023-03-03T07:43:29.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:29.056+0000 7fe8b52c2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8b008a5b0 0x7fe8b0093240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:29.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:29.056+0000 7fe8b52c2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8b008a5b0 0x7fe8b0093240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60716/0 (socket says 172.21.15.57:60716) 2023-03-03T07:43:29.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:29.056+0000 7fe8b52c2700 1 -- 172.21.15.57:0/3372818990 learned_addr learned my addr 172.21.15.57:0/3372818990 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:29.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:29.056+0000 7fe8b52c2700 1 -- 172.21.15.57:0/3372818990 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8ac0094b0 con 0x7fe8b008a5b0 2023-03-03T07:43:29.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:29.056+0000 7fe8b52c2700 1 --2- 172.21.15.57:0/3372818990 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8b008a5b0 0x7fe8b0093240 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac009b20 tx=0x7fe8ac004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:29.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:29.056+0000 7fe8a5ffb700 1 -- 172.21.15.57:0/3372818990 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe8ac006ea0 con 0x7fe8b008a5b0 2023-03-03T07:43:29.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:29.056+0000 7fe8a5ffb700 1 -- 172.21.15.57:0/3372818990 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8ac011630 con 0x7fe8b008a5b0 2023-03-03T07:43:29.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:29.056+0000 7fe8a5ffb700 1 -- 172.21.15.57:0/3372818990 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe8ac0118d0 con 0x7fe8b008a5b0 2023-03-03T07:43:29.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:29.056+0000 7fe8b62c4700 1 -- 172.21.15.57:0/3372818990 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8b008b130 con 0x7fe8b008a5b0 2023-03-03T07:43:29.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:29.056+0000 7fe8b62c4700 1 -- 172.21.15.57:0/3372818990 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8b008d1e0 con 0x7fe8b008a5b0 2023-03-03T07:43:29.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:29.060+0000 7fe8b62c4700 1 -- 172.21.15.57:0/3372818990 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8b008b2c0 con 0x7fe8b008a5b0 2023-03-03T07:43:29.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:29.060+0000 7fe8a5ffb700 1 -- 172.21.15.57:0/3372818990 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42205+0+0 (secure 0 0 0) 0x7fe8ac02d070 con 0x7fe8b008a5b0 2023-03-03T07:43:29.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:29.060+0000 7fe8a5ffb700 1 --2- 172.21.15.57:0/3372818990 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fe894034840 0x7fe894036cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:29.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:29.060+0000 7fe8a5ffb700 1 -- 172.21.15.57:0/3372818990 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 2065+0+0 (secure 0 0 0) 0x7fe8ac046e10 con 0x7fe8b008a5b0 2023-03-03T07:43:29.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:29.060+0000 7fe8b4ac1700 1 --2- 172.21.15.57:0/3372818990 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fe894034840 0x7fe894036cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:29.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:29.064+0000 7fe8b4ac1700 1 --2- 172.21.15.57:0/3372818990 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fe894034840 0x7fe894036cf0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe8a00016a0 tx=0x7fe8a0007b70 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:29.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:29.068+0000 7fe8a5ffb700 1 -- 172.21.15.57:0/3372818990 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe8ac011a80 con 0x7fe8b008a5b0 2023-03-03T07:43:29.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:29.248+0000 7fe8b62c4700 1 -- 172.21.15.57:0/3372818990 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe8b00619b0 con 0x7fe8b008a5b0 2023-03-03T07:43:29.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:29.812+0000 7fe8a5ffb700 1 -- 172.21.15.57:0/3372818990 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v11) v1 ==== 173+0+0 (secure 0 0 0) 0x7fe8ac016020 con 0x7fe8b008a5b0 2023-03-03T07:43:29.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:29.820+0000 7fe8b62c4700 1 -- 172.21.15.57:0/3372818990 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fe894034840 msgr2=0x7fe894036cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:29.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:29.820+0000 7fe8b62c4700 1 --2- 172.21.15.57:0/3372818990 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fe894034840 0x7fe894036cf0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe8a00016a0 tx=0x7fe8a0007b70 comp rx=0 tx=0).stop 2023-03-03T07:43:29.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:29.820+0000 7fe8b62c4700 1 -- 172.21.15.57:0/3372818990 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8b008a5b0 msgr2=0x7fe8b0093240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:29.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:29.820+0000 7fe8b62c4700 1 --2- 172.21.15.57:0/3372818990 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8b008a5b0 0x7fe8b0093240 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac009b20 tx=0x7fe8ac004770 comp rx=0 tx=0).stop 2023-03-03T07:43:29.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:29.820+0000 7fe8b62c4700 1 -- 172.21.15.57:0/3372818990 shutdown_connections 2023-03-03T07:43:29.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:29.820+0000 7fe8b62c4700 1 --2- 172.21.15.57:0/3372818990 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fe894034840 0x7fe894036cf0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:29.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:29.820+0000 7fe8b62c4700 1 --2- 172.21.15.57:0/3372818990 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8b008a5b0 0x7fe8b0093240 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:29.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:29.820+0000 7fe8b62c4700 1 -- 172.21.15.57:0/3372818990 >> 172.21.15.57:0/3372818990 conn(0x7fe8b006dc90 msgr2=0x7fe8b01218e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:29.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:29.820+0000 7fe8b62c4700 1 -- 172.21.15.57:0/3372818990 shutdown_connections 2023-03-03T07:43:29.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:29.820+0000 7fe8b62c4700 1 -- 172.21.15.57:0/3372818990 wait complete. 2023-03-03T07:43:29.827 INFO:teuthology.orchestra.run.smithi057.stderr:enabled application 'rbd' on pool 'rbd' 2023-03-03T07:43:29.856 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-03-03T07:43:29.856 INFO:tasks.ceph.mds.a:Restarting daemon 2023-03-03T07:43:29.857 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-03-03T07:43:29.866 INFO:tasks.ceph.mds.a:Started 2023-03-03T07:43:29.867 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-03-03T07:43:29.867 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T07:43:30.007 INFO:tasks.ceph.mds.a.smithi057.stdout:starting mds.a at 2023-03-03T07:43:30.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.072+0000 7f318932d700 1 Processor -- start 2023-03-03T07:43:30.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.072+0000 7f318932d700 1 -- start start 2023-03-03T07:43:30.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.072+0000 7f318932d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f31840948e0 0x7f318406ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:30.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.072+0000 7f318932d700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3184071950 con 0x7f318406f4b0 2023-03-03T07:43:30.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.072+0000 7f318932d700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3184071330 con 0x7f31840948e0 2023-03-03T07:43:30.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.076+0000 7f3182ffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f31840948e0 0x7f318406ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:30.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.076+0000 7f3182ffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f31840948e0 0x7f318406ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33714/0 (socket says 172.21.15.57:33714) 2023-03-03T07:43:30.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.076+0000 7f3182ffd700 1 -- 172.21.15.57:0/1638311174 learned_addr learned my addr 172.21.15.57:0/1638311174 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:30.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.076+0000 7f3182ffd700 1 -- 172.21.15.57:0/1638311174 >> v1:172.21.15.57:6789/0 conn(0x7f318406f4b0 legacy=0x7f3184128c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T07:43:30.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.076+0000 7f3182ffd700 1 -- 172.21.15.57:0/1638311174 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3184071640 con 0x7f31840948e0 2023-03-03T07:43:30.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.076+0000 7f3182ffd700 1 --2- 172.21.15.57:0/1638311174 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31840948e0 0x7f318406ef70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f317400bb30 tx=0x7f317400be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=576ccbe271c9373f server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:30.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.076+0000 7f3181ffb700 1 -- 172.21.15.57:0/1638311174 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f317400dc60 con 0x7f31840948e0 2023-03-03T07:43:30.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.076+0000 7f3181ffb700 1 -- 172.21.15.57:0/1638311174 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f317400ddc0 con 0x7f31840948e0 2023-03-03T07:43:30.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.076+0000 7f3181ffb700 1 -- 172.21.15.57:0/1638311174 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3174004180 con 0x7f31840948e0 2023-03-03T07:43:30.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.076+0000 7f318932d700 1 -- 172.21.15.57:0/1638311174 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31840948e0 msgr2=0x7f318406ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:30.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.076+0000 7f318932d700 1 --2- 172.21.15.57:0/1638311174 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31840948e0 0x7f318406ef70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f317400bb30 tx=0x7f317400be40 comp rx=0 tx=0).stop 2023-03-03T07:43:30.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.076+0000 7f318932d700 1 -- 172.21.15.57:0/1638311174 shutdown_connections 2023-03-03T07:43:30.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.076+0000 7f318932d700 1 --2- 172.21.15.57:0/1638311174 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31840948e0 0x7f318406ef70 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:30.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.076+0000 7f318932d700 1 -- 172.21.15.57:0/1638311174 >> 172.21.15.57:0/1638311174 conn(0x7f3184069f00 msgr2=0x7f318406a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:30.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.076+0000 7f318932d700 1 -- 172.21.15.57:0/1638311174 shutdown_connections 2023-03-03T07:43:30.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.080+0000 7f318932d700 1 -- 172.21.15.57:0/1638311174 wait complete. 2023-03-03T07:43:30.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.080+0000 7f318932d700 1 Processor -- start 2023-03-03T07:43:30.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.080+0000 7f318932d700 1 -- start start 2023-03-03T07:43:30.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.080+0000 7f318932d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f318406f4b0 0x7f31841b7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:30.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.080+0000 7f318932d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318411c730 con 0x7f318406f4b0 2023-03-03T07:43:30.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.084+0000 7f3182ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f318406f4b0 0x7f31841b7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:30.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.084+0000 7f3182ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f318406f4b0 0x7f31841b7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33722/0 (socket says 172.21.15.57:33722) 2023-03-03T07:43:30.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.084+0000 7f3182ffd700 1 -- 172.21.15.57:0/2618163064 learned_addr learned my addr 172.21.15.57:0/2618163064 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:30.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.084+0000 7f3182ffd700 1 -- 172.21.15.57:0/2618163064 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f317400b810 con 0x7f318406f4b0 2023-03-03T07:43:30.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.084+0000 7f3182ffd700 1 --2- 172.21.15.57:0/2618163064 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f318406f4b0 0x7f31841b7c70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f317400be80 tx=0x7f3174004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:30.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.084+0000 7f316b7fe700 1 -- 172.21.15.57:0/2618163064 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3174020070 con 0x7f318406f4b0 2023-03-03T07:43:30.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.084+0000 7f316b7fe700 1 -- 172.21.15.57:0/2618163064 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3174003ce0 con 0x7f318406f4b0 2023-03-03T07:43:30.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.084+0000 7f316b7fe700 1 -- 172.21.15.57:0/2618163064 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3174010470 con 0x7f318406f4b0 2023-03-03T07:43:30.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.084+0000 7f318932d700 1 -- 172.21.15.57:0/2618163064 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f318406faa0 con 0x7f318406f4b0 2023-03-03T07:43:30.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.084+0000 7f318932d700 1 -- 172.21.15.57:0/2618163064 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f318406f910 con 0x7f318406f4b0 2023-03-03T07:43:30.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.088+0000 7f318932d700 1 -- 172.21.15.57:0/2618163064 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f318406fc30 con 0x7f318406f4b0 2023-03-03T07:43:30.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.088+0000 7f316b7fe700 1 -- 172.21.15.57:0/2618163064 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42205+0+0 (secure 0 0 0) 0x7f317402b030 con 0x7f318406f4b0 2023-03-03T07:43:30.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.088+0000 7f316b7fe700 1 --2- 172.21.15.57:0/2618163064 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f3170034830 0x7f3170036ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:30.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.088+0000 7f316b7fe700 1 -- 172.21.15.57:0/2618163064 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2076+0+0 (secure 0 0 0) 0x7f31740499d0 con 0x7f318406f4b0 2023-03-03T07:43:30.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.088+0000 7f31827fc700 1 --2- 172.21.15.57:0/2618163064 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f3170034830 0x7f3170036ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:30.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.088+0000 7f31827fc700 1 --2- 172.21.15.57:0/2618163064 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f3170034830 0x7f3170036ce0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3178007fd0 tx=0x7f3178007ac0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:30.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.096+0000 7f316b7fe700 1 -- 172.21.15.57:0/2618163064 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f317402c950 con 0x7f318406f4b0 2023-03-03T07:43:30.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.272+0000 7f318932d700 1 -- 172.21.15.57:0/2618163064 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f318404eff0 con 0x7f318406f4b0 2023-03-03T07:43:30.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.272+0000 7f316b7fe700 1 -- 172.21.15.57:0/2618163064 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) v1 ==== 74+0+5925 (secure 0 0 0) 0x7f3174029070 con 0x7f318406f4b0 2023-03-03T07:43:30.279 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-03T07:43:30.280 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":11,"fsid":"5022d617-ad40-4ad9-8d5b-120958296d9c","created":"2023-03-03T07:43:13.256676+0000","modified":"2023-03-03T07:43:29.804038+0000","last_up_change":"2023-03-03T07:43:22.721740+0000","last_in_change":"2023-03-03T07:43:13.786190+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":1,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-03T07:43:22.864508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":1,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"9","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":1,"score_stable":1,"optimal_score":1,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-03T07:43:28.091327+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":1,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1,"score_stable":1,"optimal_score":1,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d83f7ba7-9d9d-4309-95b9-2b8ad96f2f8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":6,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":28687},{"type":"v1","addr":"172.21.15.57:6801","nonce":28687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":28687},{"type":"v1","addr":"172.21.15.57:6803","nonce":28687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":28687},{"type":"v1","addr":"172.21.15.57:6807","nonce":28687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":28687},{"type":"v1","addr":"172.21.15.57:6805","nonce":28687}]},"public_addr":"172.21.15.57:6801/28687","cluster_addr":"172.21.15.57:6803/28687","heartbeat_back_addr":"172.21.15.57:6807/28687","heartbeat_front_addr":"172.21.15.57:6805/28687","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T07:43:19.859898+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T07:43:30.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.276+0000 7f318932d700 1 -- 172.21.15.57:0/2618163064 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f3170034830 msgr2=0x7f3170036ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:30.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.276+0000 7f318932d700 1 --2- 172.21.15.57:0/2618163064 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f3170034830 0x7f3170036ce0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3178007fd0 tx=0x7f3178007ac0 comp rx=0 tx=0).stop 2023-03-03T07:43:30.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.276+0000 7f318932d700 1 -- 172.21.15.57:0/2618163064 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f318406f4b0 msgr2=0x7f31841b7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:30.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.276+0000 7f318932d700 1 --2- 172.21.15.57:0/2618163064 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f318406f4b0 0x7f31841b7c70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f317400be80 tx=0x7f3174004770 comp rx=0 tx=0).stop 2023-03-03T07:43:30.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.276+0000 7f318932d700 1 -- 172.21.15.57:0/2618163064 shutdown_connections 2023-03-03T07:43:30.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.276+0000 7f318932d700 1 --2- 172.21.15.57:0/2618163064 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f3170034830 0x7f3170036ce0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:30.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.276+0000 7f318932d700 1 --2- 172.21.15.57:0/2618163064 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f318406f4b0 0x7f31841b7c70 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:30.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.276+0000 7f318932d700 1 -- 172.21.15.57:0/2618163064 >> 172.21.15.57:0/2618163064 conn(0x7f3184069f00 msgr2=0x7f3184089f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:30.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.276+0000 7f318932d700 1 -- 172.21.15.57:0/2618163064 shutdown_connections 2023-03-03T07:43:30.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.276+0000 7f318932d700 1 -- 172.21.15.57:0/2618163064 wait complete. 2023-03-03T07:43:30.316 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-03T07:43:22.864508+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 1, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '9', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 1, 'score_stable': 1, 'optimal_score': 1, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-03-03T07:43:28.091327+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 1, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1, 'score_stable': 1, 'optimal_score': 1, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-03T07:43:30.317 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-03T07:43:30.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.524+0000 7fa469a0f700 1 Processor -- start 2023-03-03T07:43:30.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.524+0000 7fa469a0f700 1 -- start start 2023-03-03T07:43:30.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.528+0000 7fa469a0f700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa46408bf80 0x7fa46408c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:30.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.528+0000 7fa469a0f700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa46408d2b0 con 0x7fa46408c890 2023-03-03T07:43:30.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.528+0000 7fa469a0f700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa46408d550 con 0x7fa46408bf80 2023-03-03T07:43:30.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.528+0000 7fa468a0d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa46408bf80 0x7fa46408c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:30.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.528+0000 7fa463fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa46408c890 0x7fa464095b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52360/0 (socket says 172.21.15.57:52360) 2023-03-03T07:43:30.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.528+0000 7fa463fff700 1 -- 172.21.15.57:0/2562094247 learned_addr learned my addr 172.21.15.57:0/2562094247 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:43:30.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.528+0000 7fa468a0d700 1 -- 172.21.15.57:0/2562094247 >> v1:172.21.15.57:6789/0 conn(0x7fa46408c890 legacy=0x7fa464095b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:30.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.528+0000 7fa468a0d700 1 -- 172.21.15.57:0/2562094247 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa46408a500 con 0x7fa46408bf80 2023-03-03T07:43:30.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.528+0000 7fa4637fe700 1 -- 172.21.15.57:0/2562094247 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3277642424 0 0) 0x7fa46408d2b0 con 0x7fa46408c890 2023-03-03T07:43:30.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.528+0000 7fa468a0d700 1 --2- 172.21.15.57:0/2562094247 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa46408bf80 0x7fa46408c350 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa4580097c0 tx=0x7fa458009ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1072039718cba12b server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:30.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.532+0000 7fa4637fe700 1 -- 172.21.15.57:0/2562094247 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa458005d80 con 0x7fa46408bf80 2023-03-03T07:43:30.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.532+0000 7fa4637fe700 1 -- 172.21.15.57:0/2562094247 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa458004030 con 0x7fa46408bf80 2023-03-03T07:43:30.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.532+0000 7fa4637fe700 1 -- 172.21.15.57:0/2562094247 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa4580042f0 con 0x7fa46408bf80 2023-03-03T07:43:30.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.532+0000 7fa469a0f700 1 -- 172.21.15.57:0/2562094247 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa46408bf80 msgr2=0x7fa46408c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:30.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.532+0000 7fa469a0f700 1 --2- 172.21.15.57:0/2562094247 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa46408bf80 0x7fa46408c350 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa4580097c0 tx=0x7fa458009ad0 comp rx=0 tx=0).stop 2023-03-03T07:43:30.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.532+0000 7fa469a0f700 1 -- 172.21.15.57:0/2562094247 shutdown_connections 2023-03-03T07:43:30.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.532+0000 7fa469a0f700 1 --2- 172.21.15.57:0/2562094247 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa46408bf80 0x7fa46408c350 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:30.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.532+0000 7fa469a0f700 1 -- 172.21.15.57:0/2562094247 >> 172.21.15.57:0/2562094247 conn(0x7fa46406da50 msgr2=0x7fa46406fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:30.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.532+0000 7fa469a0f700 1 -- 172.21.15.57:0/2562094247 shutdown_connections 2023-03-03T07:43:30.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.532+0000 7fa469a0f700 1 -- 172.21.15.57:0/2562094247 wait complete. 2023-03-03T07:43:30.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.536+0000 7fa469a0f700 1 Processor -- start 2023-03-03T07:43:30.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.536+0000 7fa469a0f700 1 -- start start 2023-03-03T07:43:30.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.536+0000 7fa469a0f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa46408bf80 0x7fa46411fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:30.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.536+0000 7fa469a0f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa464121d50 con 0x7fa46408bf80 2023-03-03T07:43:30.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.536+0000 7fa468a0d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa46408bf80 0x7fa46411fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:30.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.536+0000 7fa468a0d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa46408bf80 0x7fa46411fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33736/0 (socket says 172.21.15.57:33736) 2023-03-03T07:43:30.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.536+0000 7fa468a0d700 1 -- 172.21.15.57:0/3049430076 learned_addr learned my addr 172.21.15.57:0/3049430076 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:30.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.536+0000 7fa468a0d700 1 -- 172.21.15.57:0/3049430076 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa458009450 con 0x7fa46408bf80 2023-03-03T07:43:30.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.536+0000 7fa468a0d700 1 --2- 172.21.15.57:0/3049430076 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa46408bf80 0x7fa46411fe40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa458009b10 tx=0x7fa458004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:30.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.536+0000 7fa4617fa700 1 -- 172.21.15.57:0/3049430076 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa45801d430 con 0x7fa46408bf80 2023-03-03T07:43:30.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.540+0000 7fa4617fa700 1 -- 172.21.15.57:0/3049430076 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa45801d590 con 0x7fa46408bf80 2023-03-03T07:43:30.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.540+0000 7fa4617fa700 1 -- 172.21.15.57:0/3049430076 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa45801d870 con 0x7fa46408bf80 2023-03-03T07:43:30.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.540+0000 7fa469a0f700 1 -- 172.21.15.57:0/3049430076 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4640963a0 con 0x7fa46408bf80 2023-03-03T07:43:30.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.540+0000 7fa469a0f700 1 -- 172.21.15.57:0/3049430076 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa464096210 con 0x7fa46408bf80 2023-03-03T07:43:30.547 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.540+0000 7fa4617fa700 1 -- 172.21.15.57:0/3049430076 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42205+0+0 (secure 0 0 0) 0x7fa45802d070 con 0x7fa46408bf80 2023-03-03T07:43:30.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.540+0000 7fa469a0f700 1 -- 172.21.15.57:0/3049430076 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa464096530 con 0x7fa46408bf80 2023-03-03T07:43:30.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.540+0000 7fa4617fa700 1 --2- 172.21.15.57:0/3049430076 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fa448034830 0x7fa448036ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:30.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.540+0000 7fa4617fa700 1 -- 172.21.15.57:0/3049430076 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2076+0+0 (secure 0 0 0) 0x7fa458006e40 con 0x7fa46408bf80 2023-03-03T07:43:30.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.540+0000 7fa463fff700 1 --2- 172.21.15.57:0/3049430076 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fa448034830 0x7fa448036ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:30.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.544+0000 7fa463fff700 1 --2- 172.21.15.57:0/3049430076 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fa448034830 0x7fa448036ce0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa450000c00 tx=0x7fa450007a20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:30.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.548+0000 7fa4617fa700 1 -- 172.21.15.57:0/3049430076 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa45801da20 con 0x7fa46408bf80 2023-03-03T07:43:30.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.720+0000 7fa469a0f700 1 -- 172.21.15.57:0/3049430076 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa4640619b0 con 0x7fa46408bf80 2023-03-03T07:43:30.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.720+0000 7fa4617fa700 1 -- 172.21.15.57:0/3049430076 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v11) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa458016020 con 0x7fa46408bf80 2023-03-03T07:43:30.727 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-03-03T07:43:30.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.724+0000 7fa469a0f700 1 -- 172.21.15.57:0/3049430076 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fa448034830 msgr2=0x7fa448036ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:30.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.724+0000 7fa469a0f700 1 --2- 172.21.15.57:0/3049430076 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fa448034830 0x7fa448036ce0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa450000c00 tx=0x7fa450007a20 comp rx=0 tx=0).stop 2023-03-03T07:43:30.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.724+0000 7fa469a0f700 1 -- 172.21.15.57:0/3049430076 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa46408bf80 msgr2=0x7fa46411fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:30.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.724+0000 7fa469a0f700 1 --2- 172.21.15.57:0/3049430076 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa46408bf80 0x7fa46411fe40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa458009b10 tx=0x7fa458004770 comp rx=0 tx=0).stop 2023-03-03T07:43:30.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.728+0000 7fa469a0f700 1 -- 172.21.15.57:0/3049430076 shutdown_connections 2023-03-03T07:43:30.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.728+0000 7fa469a0f700 1 --2- 172.21.15.57:0/3049430076 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fa448034830 0x7fa448036ce0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:30.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.728+0000 7fa469a0f700 1 --2- 172.21.15.57:0/3049430076 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa46408bf80 0x7fa46411fe40 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:30.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.728+0000 7fa469a0f700 1 -- 172.21.15.57:0/3049430076 >> 172.21.15.57:0/3049430076 conn(0x7fa46406da50 msgr2=0x7fa46406fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:30.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.728+0000 7fa469a0f700 1 -- 172.21.15.57:0/3049430076 shutdown_connections 2023-03-03T07:43:30.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.728+0000 7fa469a0f700 1 -- 172.21.15.57:0/3049430076 wait complete. 2023-03-03T07:43:30.763 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-03T07:43:30.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.968+0000 7f939dc84700 1 Processor -- start 2023-03-03T07:43:30.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.968+0000 7f939dc84700 1 -- start start 2023-03-03T07:43:30.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.972+0000 7f939dc84700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9398128860 0x7f939812ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:30.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.972+0000 7f939dc84700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9398096a10 con 0x7f9398095f30 2023-03-03T07:43:30.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.972+0000 7f939dc84700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f939808e410 con 0x7f9398128860 2023-03-03T07:43:30.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.972+0000 7f9397fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9398128860 0x7f939812ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:30.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.972+0000 7f939cc82700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f9398095f30 0x7f9398096300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52372/0 (socket says 172.21.15.57:52372) 2023-03-03T07:43:30.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.972+0000 7f939cc82700 1 -- 172.21.15.57:0/2634426274 learned_addr learned my addr 172.21.15.57:0/2634426274 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:43:30.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.972+0000 7f9397fff700 1 -- 172.21.15.57:0/2634426274 >> v1:172.21.15.57:6789/0 conn(0x7f9398095f30 legacy=0x7f9398096300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:30.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.972+0000 7f9397fff700 1 -- 172.21.15.57:0/2634426274 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f939808b510 con 0x7f9398128860 2023-03-03T07:43:30.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.972+0000 7f9397fff700 1 --2- 172.21.15.57:0/2634426274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9398128860 0x7f939812ac40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f93840097d0 tx=0x7f9384009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac16e403f54eb2de server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:30.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.972+0000 7f93977fe700 1 -- 172.21.15.57:0/2634426274 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f93840041c0 con 0x7f9398128860 2023-03-03T07:43:30.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.972+0000 7f93977fe700 1 -- 172.21.15.57:0/2634426274 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9384004320 con 0x7f9398128860 2023-03-03T07:43:30.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.972+0000 7f93977fe700 1 -- 172.21.15.57:0/2634426274 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f93840036c0 con 0x7f9398128860 2023-03-03T07:43:30.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.976+0000 7f939dc84700 1 -- 172.21.15.57:0/2634426274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9398128860 msgr2=0x7f939812ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:30.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.976+0000 7f939dc84700 1 --2- 172.21.15.57:0/2634426274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9398128860 0x7f939812ac40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f93840097d0 tx=0x7f9384009ae0 comp rx=0 tx=0).stop 2023-03-03T07:43:30.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.976+0000 7f939dc84700 1 -- 172.21.15.57:0/2634426274 shutdown_connections 2023-03-03T07:43:30.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.976+0000 7f939dc84700 1 --2- 172.21.15.57:0/2634426274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9398128860 0x7f939812ac40 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:30.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.976+0000 7f939dc84700 1 -- 172.21.15.57:0/2634426274 >> 172.21.15.57:0/2634426274 conn(0x7f939806da50 msgr2=0x7f939806fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:30.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.976+0000 7f939dc84700 1 -- 172.21.15.57:0/2634426274 shutdown_connections 2023-03-03T07:43:30.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.976+0000 7f939dc84700 1 -- 172.21.15.57:0/2634426274 wait complete. 2023-03-03T07:43:30.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.980+0000 7f939dc84700 1 Processor -- start 2023-03-03T07:43:30.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.980+0000 7f939dc84700 1 -- start start 2023-03-03T07:43:30.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.980+0000 7f939dc84700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9398095f30 0x7f93981bbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:30.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.980+0000 7f939dc84700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93981bb800 con 0x7f9398095f30 2023-03-03T07:43:30.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.980+0000 7f939cc82700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9398095f30 0x7f93981bbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:30.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.980+0000 7f939cc82700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9398095f30 0x7f93981bbcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33742/0 (socket says 172.21.15.57:33742) 2023-03-03T07:43:30.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.980+0000 7f939cc82700 1 -- 172.21.15.57:0/639982179 learned_addr learned my addr 172.21.15.57:0/639982179 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:30.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.980+0000 7f939cc82700 1 -- 172.21.15.57:0/639982179 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93840094b0 con 0x7f9398095f30 2023-03-03T07:43:30.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.980+0000 7f939cc82700 1 --2- 172.21.15.57:0/639982179 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9398095f30 0x7f93981bbcc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f938c00c680 tx=0x7f938c00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:30.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.980+0000 7f93957fa700 1 -- 172.21.15.57:0/639982179 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f938c007410 con 0x7f9398095f30 2023-03-03T07:43:30.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.980+0000 7f93957fa700 1 -- 172.21.15.57:0/639982179 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f938c007570 con 0x7f9398095f30 2023-03-03T07:43:30.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.980+0000 7f93957fa700 1 -- 172.21.15.57:0/639982179 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f938c005850 con 0x7f9398095f30 2023-03-03T07:43:30.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.980+0000 7f939dc84700 1 -- 172.21.15.57:0/639982179 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f939812b310 con 0x7f9398095f30 2023-03-03T07:43:30.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.980+0000 7f939dc84700 1 -- 172.21.15.57:0/639982179 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f939812b180 con 0x7f9398095f30 2023-03-03T07:43:30.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.984+0000 7f939dc84700 1 -- 172.21.15.57:0/639982179 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f939812b4a0 con 0x7f9398095f30 2023-03-03T07:43:30.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.984+0000 7f93957fa700 1 -- 172.21.15.57:0/639982179 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42205+0+0 (secure 0 0 0) 0x7f938c019030 con 0x7f9398095f30 2023-03-03T07:43:30.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.984+0000 7f93957fa700 1 --2- 172.21.15.57:0/639982179 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f937c034840 0x7f937c036cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:30.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.988+0000 7f93957fa700 1 -- 172.21.15.57:0/639982179 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2076+0+0 (secure 0 0 0) 0x7f938c045040 con 0x7f9398095f30 2023-03-03T07:43:30.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.988+0000 7f9397fff700 1 --2- 172.21.15.57:0/639982179 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f937c034840 0x7f937c036cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:30.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.988+0000 7f9397fff700 1 --2- 172.21.15.57:0/639982179 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f937c034840 0x7f937c036cf0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9384014040 tx=0x7f9384010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:31.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:30.996+0000 7f93957fa700 1 -- 172.21.15.57:0/639982179 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f938c019680 con 0x7f9398095f30 2023-03-03T07:43:31.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.172+0000 7f939dc84700 1 -- 172.21.15.57:0/639982179 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9398096a10 con 0x7f9398095f30 2023-03-03T07:43:31.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.176+0000 7f93957fa700 1 -- 172.21.15.57:0/639982179 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v12) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9398096a10 con 0x7f9398095f30 2023-03-03T07:43:31.181 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2023-03-03T07:43:31.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.180+0000 7f939dc84700 1 -- 172.21.15.57:0/639982179 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f937c034840 msgr2=0x7f937c036cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:31.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.180+0000 7f939dc84700 1 --2- 172.21.15.57:0/639982179 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f937c034840 0x7f937c036cf0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9384014040 tx=0x7f9384010000 comp rx=0 tx=0).stop 2023-03-03T07:43:31.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.180+0000 7f939dc84700 1 -- 172.21.15.57:0/639982179 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9398095f30 msgr2=0x7f93981bbcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:31.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.180+0000 7f939dc84700 1 --2- 172.21.15.57:0/639982179 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9398095f30 0x7f93981bbcc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f938c00c680 tx=0x7f938c00ca40 comp rx=0 tx=0).stop 2023-03-03T07:43:31.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.180+0000 7f939dc84700 1 -- 172.21.15.57:0/639982179 shutdown_connections 2023-03-03T07:43:31.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.180+0000 7f939dc84700 1 --2- 172.21.15.57:0/639982179 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f937c034840 0x7f937c036cf0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:31.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.180+0000 7f939dc84700 1 --2- 172.21.15.57:0/639982179 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9398095f30 0x7f93981bbcc0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:31.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.180+0000 7f939dc84700 1 -- 172.21.15.57:0/639982179 >> 172.21.15.57:0/639982179 conn(0x7f939806da50 msgr2=0x7f93981202f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:31.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.180+0000 7f939dc84700 1 -- 172.21.15.57:0/639982179 shutdown_connections 2023-03-03T07:43:31.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.180+0000 7f939dc84700 1 -- 172.21.15.57:0/639982179 wait complete. 2023-03-03T07:43:31.221 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-03T07:43:31.423 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.416+0000 7f1a696ab700 1 Processor -- start 2023-03-03T07:43:31.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.416+0000 7f1a696ab700 1 -- start start 2023-03-03T07:43:31.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.420+0000 7f1a696ab700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1a640992b0 0x7f1a64099680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:31.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.420+0000 7f1a696ab700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a6408f6a0 con 0x7f1a6408e390 2023-03-03T07:43:31.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.420+0000 7f1a696ab700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a64072220 con 0x7f1a640992b0 2023-03-03T07:43:31.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.420+0000 7f1a63fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1a640992b0 0x7f1a64099680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:31.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.420+0000 7f1a63fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1a640992b0 0x7f1a64099680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33758/0 (socket says 172.21.15.57:33758) 2023-03-03T07:43:31.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.420+0000 7f1a63fff700 1 -- 172.21.15.57:0/2939904998 learned_addr learned my addr 172.21.15.57:0/2939904998 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:31.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.420+0000 7f1a62ffd700 1 -- 172.21.15.57:0/2939904998 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3594806229 0 0) 0x7f1a6408f6a0 con 0x7f1a6408e390 2023-03-03T07:43:31.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.420+0000 7f1a62ffd700 1 -- 172.21.15.57:0/2939904998 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a4c0035d0 con 0x7f1a6408e390 2023-03-03T07:43:31.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.420+0000 7f1a63fff700 1 -- 172.21.15.57:0/2939904998 >> v1:172.21.15.57:6789/0 conn(0x7f1a6408e390 legacy=0x7f1a6408e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:31.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.420+0000 7f1a63fff700 1 -- 172.21.15.57:0/2939904998 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a6408f970 con 0x7f1a640992b0 2023-03-03T07:43:31.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.420+0000 7f1a63fff700 1 --2- 172.21.15.57:0/2939904998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a640992b0 0x7f1a64099680 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1a54009890 tx=0x7f1a54009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50c2f92b9ddea283 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:31.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.420+0000 7f1a62ffd700 1 -- 172.21.15.57:0/2939904998 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a54004160 con 0x7f1a640992b0 2023-03-03T07:43:31.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.420+0000 7f1a62ffd700 1 -- 172.21.15.57:0/2939904998 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a540042c0 con 0x7f1a640992b0 2023-03-03T07:43:31.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.420+0000 7f1a62ffd700 1 -- 172.21.15.57:0/2939904998 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a54004580 con 0x7f1a640992b0 2023-03-03T07:43:31.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.424+0000 7f1a696ab700 1 -- 172.21.15.57:0/2939904998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a640992b0 msgr2=0x7f1a64099680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:31.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.424+0000 7f1a696ab700 1 --2- 172.21.15.57:0/2939904998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a640992b0 0x7f1a64099680 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1a54009890 tx=0x7f1a54009ba0 comp rx=0 tx=0).stop 2023-03-03T07:43:31.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.424+0000 7f1a696ab700 1 -- 172.21.15.57:0/2939904998 shutdown_connections 2023-03-03T07:43:31.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.424+0000 7f1a696ab700 1 --2- 172.21.15.57:0/2939904998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a640992b0 0x7f1a64099680 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:31.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.424+0000 7f1a696ab700 1 -- 172.21.15.57:0/2939904998 >> 172.21.15.57:0/2939904998 conn(0x7f1a6406cc70 msgr2=0x7f1a6406f080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:31.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.424+0000 7f1a696ab700 1 -- 172.21.15.57:0/2939904998 shutdown_connections 2023-03-03T07:43:31.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.424+0000 7f1a696ab700 1 -- 172.21.15.57:0/2939904998 wait complete. 2023-03-03T07:43:31.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.424+0000 7f1a696ab700 1 Processor -- start 2023-03-03T07:43:31.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.428+0000 7f1a696ab700 1 -- start start 2023-03-03T07:43:31.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.428+0000 7f1a696ab700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a6408e390 0x7f1a641c0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:31.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.428+0000 7f1a696ab700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6408cb30 con 0x7f1a6408e390 2023-03-03T07:43:31.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.428+0000 7f1a63fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a6408e390 0x7f1a641c0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:31.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.428+0000 7f1a63fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a6408e390 0x7f1a641c0250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33762/0 (socket says 172.21.15.57:33762) 2023-03-03T07:43:31.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.428+0000 7f1a63fff700 1 -- 172.21.15.57:0/3608900592 learned_addr learned my addr 172.21.15.57:0/3608900592 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:31.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.428+0000 7f1a63fff700 1 -- 172.21.15.57:0/3608900592 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a54009570 con 0x7f1a6408e390 2023-03-03T07:43:31.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.428+0000 7f1a63fff700 1 --2- 172.21.15.57:0/3608900592 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a6408e390 0x7f1a641c0250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1a6404e1f0 tx=0x7f1a54004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:31.436 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.432+0000 7f1a60ff9700 1 -- 172.21.15.57:0/3608900592 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a54003be0 con 0x7f1a6408e390 2023-03-03T07:43:31.436 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.432+0000 7f1a60ff9700 1 -- 172.21.15.57:0/3608900592 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a5401f070 con 0x7f1a6408e390 2023-03-03T07:43:31.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.432+0000 7f1a60ff9700 1 -- 172.21.15.57:0/3608900592 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a54003e70 con 0x7f1a6408e390 2023-03-03T07:43:31.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.432+0000 7f1a696ab700 1 -- 172.21.15.57:0/3608900592 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a64099d50 con 0x7f1a6408e390 2023-03-03T07:43:31.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.432+0000 7f1a696ab700 1 -- 172.21.15.57:0/3608900592 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a64099bc0 con 0x7f1a6408e390 2023-03-03T07:43:31.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.432+0000 7f1a60ff9700 1 -- 172.21.15.57:0/3608900592 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42205+0+0 (secure 0 0 0) 0x7f1a54017020 con 0x7f1a6408e390 2023-03-03T07:43:31.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.432+0000 7f1a696ab700 1 -- 172.21.15.57:0/3608900592 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a6408ef00 con 0x7f1a6408e390 2023-03-03T07:43:31.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.432+0000 7f1a60ff9700 1 --2- 172.21.15.57:0/3608900592 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f1a50034840 0x7f1a50036cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:31.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.432+0000 7f1a60ff9700 1 -- 172.21.15.57:0/3608900592 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2076+0+0 (secure 0 0 0) 0x7f1a540473c0 con 0x7f1a6408e390 2023-03-03T07:43:31.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.436+0000 7f1a637fe700 1 --2- 172.21.15.57:0/3608900592 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f1a50034840 0x7f1a50036cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:31.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.436+0000 7f1a637fe700 1 --2- 172.21.15.57:0/3608900592 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f1a50034840 0x7f1a50036cf0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1a58001630 tx=0x7f1a58007970 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:31.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.440+0000 7f1a60ff9700 1 -- 172.21.15.57:0/3608900592 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1a54011630 con 0x7f1a6408e390 2023-03-03T07:43:31.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.648+0000 7f1a696ab700 1 -- 172.21.15.57:0/3608900592 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1a640619b0 con 0x7f1a6408e390 2023-03-03T07:43:31.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.648+0000 7f1a60ff9700 1 -- 172.21.15.57:0/3608900592 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1256 (secure 0 0 0) 0x7f1a54032500 con 0x7f1a6408e390 2023-03-03T07:43:31.655 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-03T07:43:31.655 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4134,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6811/2058274046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2058274046},{"type":"v1","addr":"172.21.15.57:6811","nonce":2058274046}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-03-03T07:43:31.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.656+0000 7f1a696ab700 1 -- 172.21.15.57:0/3608900592 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f1a50034840 msgr2=0x7f1a50036cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:31.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.656+0000 7f1a696ab700 1 --2- 172.21.15.57:0/3608900592 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f1a50034840 0x7f1a50036cf0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1a58001630 tx=0x7f1a58007970 comp rx=0 tx=0).stop 2023-03-03T07:43:31.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.656+0000 7f1a696ab700 1 -- 172.21.15.57:0/3608900592 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a6408e390 msgr2=0x7f1a641c0250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:31.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.656+0000 7f1a696ab700 1 --2- 172.21.15.57:0/3608900592 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a6408e390 0x7f1a641c0250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1a6404e1f0 tx=0x7f1a54004770 comp rx=0 tx=0).stop 2023-03-03T07:43:31.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.656+0000 7f1a696ab700 1 -- 172.21.15.57:0/3608900592 shutdown_connections 2023-03-03T07:43:31.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.656+0000 7f1a696ab700 1 --2- 172.21.15.57:0/3608900592 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f1a50034840 0x7f1a50036cf0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:31.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.656+0000 7f1a696ab700 1 --2- 172.21.15.57:0/3608900592 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a6408e390 0x7f1a641c0250 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:31.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.656+0000 7f1a696ab700 1 -- 172.21.15.57:0/3608900592 >> 172.21.15.57:0/3608900592 conn(0x7f1a6406cc70 msgr2=0x7f1a6406e320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:31.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.656+0000 7f1a696ab700 1 -- 172.21.15.57:0/3608900592 shutdown_connections 2023-03-03T07:43:31.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.656+0000 7f1a696ab700 1 -- 172.21.15.57:0/3608900592 wait complete. 2023-03-03T07:43:31.665 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 2 2023-03-03T07:43:31.694 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T07:43:31.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.896+0000 7fe0015d9700 1 Processor -- start 2023-03-03T07:43:31.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.896+0000 7fe0015d9700 1 -- start start 2023-03-03T07:43:31.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.900+0000 7fe0015d9700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdffc127900 0x7fdffc129ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:31.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.900+0000 7fe0015d9700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdffc1245f0 con 0x7fdffc124b10 2023-03-03T07:43:31.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.900+0000 7fe0015d9700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdffc089f80 con 0x7fdffc127900 2023-03-03T07:43:31.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.900+0000 7fdff3fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdffc127900 0x7fdffc129ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:31.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.900+0000 7fdff3fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdffc127900 0x7fdffc129ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33770/0 (socket says 172.21.15.57:33770) 2023-03-03T07:43:31.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.900+0000 7fdff3fff700 1 -- 172.21.15.57:0/652453085 learned_addr learned my addr 172.21.15.57:0/652453085 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:31.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.900+0000 7fdffaffd700 1 --1- 172.21.15.57:0/652453085 >> v1:172.21.15.57:6789/0 conn(0x7fdffc124b10 0x7fdffc124ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52386/0 (socket says 172.21.15.57:52386) 2023-03-03T07:43:31.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.900+0000 7fdff3fff700 1 -- 172.21.15.57:0/652453085 >> v1:172.21.15.57:6789/0 conn(0x7fdffc124b10 legacy=0x7fdffc124ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T07:43:31.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.900+0000 7fdff3fff700 1 -- 172.21.15.57:0/652453085 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdffc08a290 con 0x7fdffc127900 2023-03-03T07:43:31.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.900+0000 7fdff3fff700 1 --2- 172.21.15.57:0/652453085 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdffc127900 0x7fdffc129ce0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4009aa0 tx=0x7fdfe4009db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8bfccd18d4333c1 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:31.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.900+0000 7fdffa7fc700 1 -- 172.21.15.57:0/652453085 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdfe400baf0 con 0x7fdffc127900 2023-03-03T07:43:31.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.900+0000 7fdffa7fc700 1 -- 172.21.15.57:0/652453085 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe400bc50 con 0x7fdffc127900 2023-03-03T07:43:31.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.904+0000 7fdffa7fc700 1 -- 172.21.15.57:0/652453085 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdfe4004030 con 0x7fdffc127900 2023-03-03T07:43:31.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.904+0000 7fe0015d9700 1 -- 172.21.15.57:0/652453085 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdffc127900 msgr2=0x7fdffc129ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:31.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.904+0000 7fe0015d9700 1 --2- 172.21.15.57:0/652453085 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdffc127900 0x7fdffc129ce0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4009aa0 tx=0x7fdfe4009db0 comp rx=0 tx=0).stop 2023-03-03T07:43:31.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.904+0000 7fe0015d9700 1 -- 172.21.15.57:0/652453085 shutdown_connections 2023-03-03T07:43:31.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.904+0000 7fe0015d9700 1 --2- 172.21.15.57:0/652453085 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdffc127900 0x7fdffc129ce0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:31.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.904+0000 7fe0015d9700 1 -- 172.21.15.57:0/652453085 >> 172.21.15.57:0/652453085 conn(0x7fdffc069f00 msgr2=0x7fdffc06a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:31.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.904+0000 7fe0015d9700 1 -- 172.21.15.57:0/652453085 shutdown_connections 2023-03-03T07:43:31.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.904+0000 7fe0015d9700 1 -- 172.21.15.57:0/652453085 wait complete. 2023-03-03T07:43:31.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.904+0000 7fe0015d9700 1 Processor -- start 2023-03-03T07:43:31.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.904+0000 7fe0015d9700 1 -- start start 2023-03-03T07:43:31.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.908+0000 7fe0015d9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdffc124b10 0x7fdffc119fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:31.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.908+0000 7fe0015d9700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdffc11b750 con 0x7fdffc124b10 2023-03-03T07:43:31.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.908+0000 7fdffaffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdffc124b10 0x7fdffc119fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:31.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.908+0000 7fdffaffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdffc124b10 0x7fdffc119fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33786/0 (socket says 172.21.15.57:33786) 2023-03-03T07:43:31.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.908+0000 7fdffaffd700 1 -- 172.21.15.57:0/3373616823 learned_addr learned my addr 172.21.15.57:0/3373616823 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:31.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.908+0000 7fdffaffd700 1 -- 172.21.15.57:0/3373616823 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfe4009570 con 0x7fdffc124b10 2023-03-03T07:43:31.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.908+0000 7fdffaffd700 1 --2- 172.21.15.57:0/3373616823 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdffc124b10 0x7fdffc119fc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdfec00c480 tx=0x7fdfec00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:31.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.908+0000 7fdff37fe700 1 -- 172.21.15.57:0/3373616823 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdfec005c00 con 0x7fdffc124b10 2023-03-03T07:43:31.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.908+0000 7fe0015d9700 1 -- 172.21.15.57:0/3373616823 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdffc06f990 con 0x7fdffc124b10 2023-03-03T07:43:31.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.908+0000 7fe0015d9700 1 -- 172.21.15.57:0/3373616823 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdffc06f800 con 0x7fdffc124b10 2023-03-03T07:43:31.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.908+0000 7fdff37fe700 1 -- 172.21.15.57:0/3373616823 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfec005d60 con 0x7fdffc124b10 2023-03-03T07:43:31.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.908+0000 7fdff37fe700 1 -- 172.21.15.57:0/3373616823 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdfec0070d0 con 0x7fdffc124b10 2023-03-03T07:43:31.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.912+0000 7fe0015d9700 1 -- 172.21.15.57:0/3373616823 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdffc06fb20 con 0x7fdffc124b10 2023-03-03T07:43:31.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.912+0000 7fdff37fe700 1 -- 172.21.15.57:0/3373616823 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42205+0+0 (secure 0 0 0) 0x7fdfec019030 con 0x7fdffc124b10 2023-03-03T07:43:31.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.912+0000 7fdff37fe700 1 --2- 172.21.15.57:0/3373616823 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fdfdc034840 0x7fdfdc036cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:31.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.912+0000 7fdff37fe700 1 -- 172.21.15.57:0/3373616823 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2076+0+0 (secure 0 0 0) 0x7fdfec045010 con 0x7fdffc124b10 2023-03-03T07:43:31.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.912+0000 7fdff3fff700 1 --2- 172.21.15.57:0/3373616823 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fdfdc034840 0x7fdfdc036cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:31.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.916+0000 7fdff3fff700 1 --2- 172.21.15.57:0/3373616823 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fdfdc034840 0x7fdfdc036cf0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4009df0 tx=0x7fdfe4008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:31.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:31.920+0000 7fdff37fe700 1 -- 172.21.15.57:0/3373616823 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fdfec01b3b0 con 0x7fdffc124b10 2023-03-03T07:43:32.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.096+0000 7fe0015d9700 1 -- 172.21.15.57:0/3373616823 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdffc04eff0 con 0x7fdffc124b10 2023-03-03T07:43:32.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.096+0000 7fdff37fe700 1 -- 172.21.15.57:0/3373616823 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+5912 (secure 0 0 0) 0x7fdfec017030 con 0x7fdffc124b10 2023-03-03T07:43:32.103 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-03T07:43:32.103 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":12,"fsid":"5022d617-ad40-4ad9-8d5b-120958296d9c","created":"2023-03-03T07:43:13.256676+0000","modified":"2023-03-03T07:43:30.814661+0000","last_up_change":"2023-03-03T07:43:22.721740+0000","last_in_change":"2023-03-03T07:43:13.786190+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":1,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-03T07:43:22.864508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":1,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"9","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":1,"score_stable":1,"optimal_score":1,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-03T07:43:28.091327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":1,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1,"score_stable":1,"optimal_score":1,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d83f7ba7-9d9d-4309-95b9-2b8ad96f2f8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":6,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":28687},{"type":"v1","addr":"172.21.15.57:6801","nonce":28687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":28687},{"type":"v1","addr":"172.21.15.57:6803","nonce":28687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":28687},{"type":"v1","addr":"172.21.15.57:6807","nonce":28687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":28687},{"type":"v1","addr":"172.21.15.57:6805","nonce":28687}]},"public_addr":"172.21.15.57:6801/28687","cluster_addr":"172.21.15.57:6803/28687","heartbeat_back_addr":"172.21.15.57:6807/28687","heartbeat_front_addr":"172.21.15.57:6805/28687","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T07:43:19.859898+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T07:43:32.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.100+0000 7fe0015d9700 1 -- 172.21.15.57:0/3373616823 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fdfdc034840 msgr2=0x7fdfdc036cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:32.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.100+0000 7fe0015d9700 1 --2- 172.21.15.57:0/3373616823 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fdfdc034840 0x7fdfdc036cf0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4009df0 tx=0x7fdfe4008030 comp rx=0 tx=0).stop 2023-03-03T07:43:32.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.100+0000 7fe0015d9700 1 -- 172.21.15.57:0/3373616823 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdffc124b10 msgr2=0x7fdffc119fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:32.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.100+0000 7fe0015d9700 1 --2- 172.21.15.57:0/3373616823 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdffc124b10 0x7fdffc119fc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdfec00c480 tx=0x7fdfec00c840 comp rx=0 tx=0).stop 2023-03-03T07:43:32.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.100+0000 7fe0015d9700 1 -- 172.21.15.57:0/3373616823 shutdown_connections 2023-03-03T07:43:32.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.100+0000 7fe0015d9700 1 --2- 172.21.15.57:0/3373616823 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fdfdc034840 0x7fdfdc036cf0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:32.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.100+0000 7fe0015d9700 1 --2- 172.21.15.57:0/3373616823 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdffc124b10 0x7fdffc119fc0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:32.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.100+0000 7fe0015d9700 1 -- 172.21.15.57:0/3373616823 >> 172.21.15.57:0/3373616823 conn(0x7fdffc069f00 msgr2=0x7fdffc08a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:32.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.100+0000 7fe0015d9700 1 -- 172.21.15.57:0/3373616823 shutdown_connections 2023-03-03T07:43:32.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.100+0000 7fe0015d9700 1 -- 172.21.15.57:0/3373616823 wait complete. 2023-03-03T07:43:32.140 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-03T07:43:22.864508+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 1, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '9', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 1, 'score_stable': 1, 'optimal_score': 1, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-03-03T07:43:28.091327+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 1, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1, 'score_stable': 1, 'optimal_score': 1, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-03T07:43:32.140 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-03T07:43:32.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.344+0000 7f9a492a7700 1 Processor -- start 2023-03-03T07:43:32.349 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.344+0000 7f9a492a7700 1 -- start start 2023-03-03T07:43:32.350 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.344+0000 7f9a492a7700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9a44124db0 0x7f9a4408a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:32.350 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.344+0000 7f9a492a7700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a44124330 con 0x7f9a441249e0 2023-03-03T07:43:32.350 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.344+0000 7f9a492a7700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a44125210 con 0x7f9a44124db0 2023-03-03T07:43:32.351 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.344+0000 7f9a427fc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9a44124db0 0x7f9a4408a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:32.351 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.344+0000 7f9a42ffd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f9a441249e0 0x7f9a44089f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52398/0 (socket says 172.21.15.57:52398) 2023-03-03T07:43:32.351 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.344+0000 7f9a42ffd700 1 -- 172.21.15.57:0/2675417454 learned_addr learned my addr 172.21.15.57:0/2675417454 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:43:32.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.344+0000 7f9a427fc700 1 -- 172.21.15.57:0/2675417454 >> v1:172.21.15.57:6789/0 conn(0x7f9a441249e0 legacy=0x7f9a44089f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:32.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.344+0000 7f9a427fc700 1 -- 172.21.15.57:0/2675417454 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a4408d340 con 0x7f9a44124db0 2023-03-03T07:43:32.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.344+0000 7f9a41ffb700 1 -- 172.21.15.57:0/2675417454 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1179897929 0 0) 0x7f9a44124330 con 0x7f9a441249e0 2023-03-03T07:43:32.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.348+0000 7f9a427fc700 1 --2- 172.21.15.57:0/2675417454 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a44124db0 0x7f9a4408a690 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9a380099e0 tx=0x7f9a38009cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=481ca064fe5b5cc3 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:32.353 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.348+0000 7f9a41ffb700 1 -- 172.21.15.57:0/2675417454 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a38004160 con 0x7f9a44124db0 2023-03-03T07:43:32.353 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.348+0000 7f9a41ffb700 1 -- 172.21.15.57:0/2675417454 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a380042c0 con 0x7f9a44124db0 2023-03-03T07:43:32.353 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.348+0000 7f9a41ffb700 1 -- 172.21.15.57:0/2675417454 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a38004580 con 0x7f9a44124db0 2023-03-03T07:43:32.354 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.348+0000 7f9a492a7700 1 -- 172.21.15.57:0/2675417454 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a44124db0 msgr2=0x7f9a4408a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:32.354 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.348+0000 7f9a492a7700 1 --2- 172.21.15.57:0/2675417454 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a44124db0 0x7f9a4408a690 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9a380099e0 tx=0x7f9a38009cf0 comp rx=0 tx=0).stop 2023-03-03T07:43:32.354 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.348+0000 7f9a492a7700 1 -- 172.21.15.57:0/2675417454 shutdown_connections 2023-03-03T07:43:32.354 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.348+0000 7f9a492a7700 1 --2- 172.21.15.57:0/2675417454 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a44124db0 0x7f9a4408a690 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:32.354 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.348+0000 7f9a492a7700 1 -- 172.21.15.57:0/2675417454 >> 172.21.15.57:0/2675417454 conn(0x7f9a44069f00 msgr2=0x7f9a4406a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:32.354 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.348+0000 7f9a492a7700 1 -- 172.21.15.57:0/2675417454 shutdown_connections 2023-03-03T07:43:32.355 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.348+0000 7f9a492a7700 1 -- 172.21.15.57:0/2675417454 wait complete. 2023-03-03T07:43:32.356 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.352+0000 7f9a492a7700 1 Processor -- start 2023-03-03T07:43:32.356 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.352+0000 7f9a492a7700 1 -- start start 2023-03-03T07:43:32.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.352+0000 7f9a492a7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a441249e0 0x7f9a4411f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:32.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.352+0000 7f9a492a7700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a44123ca0 con 0x7f9a441249e0 2023-03-03T07:43:32.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.352+0000 7f9a42ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a441249e0 0x7f9a4411f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:32.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.352+0000 7f9a42ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a441249e0 0x7f9a4411f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33804/0 (socket says 172.21.15.57:33804) 2023-03-03T07:43:32.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.352+0000 7f9a42ffd700 1 -- 172.21.15.57:0/2772493545 learned_addr learned my addr 172.21.15.57:0/2772493545 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:32.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.352+0000 7f9a42ffd700 1 -- 172.21.15.57:0/2772493545 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a380094b0 con 0x7f9a441249e0 2023-03-03T07:43:32.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.352+0000 7f9a42ffd700 1 --2- 172.21.15.57:0/2772493545 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a441249e0 0x7f9a4411f4c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9a3400c4d0 tx=0x7f9a3400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:32.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.352+0000 7f9a2b7fe700 1 -- 172.21.15.57:0/2772493545 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a34004bd0 con 0x7f9a441249e0 2023-03-03T07:43:32.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.356+0000 7f9a2b7fe700 1 -- 172.21.15.57:0/2772493545 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a34004d50 con 0x7f9a441249e0 2023-03-03T07:43:32.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.356+0000 7f9a2b7fe700 1 -- 172.21.15.57:0/2772493545 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a340070d0 con 0x7f9a441249e0 2023-03-03T07:43:32.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.356+0000 7f9a492a7700 1 -- 172.21.15.57:0/2772493545 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a4408abd0 con 0x7f9a441249e0 2023-03-03T07:43:32.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.356+0000 7f9a492a7700 1 -- 172.21.15.57:0/2772493545 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a4406b3c0 con 0x7f9a441249e0 2023-03-03T07:43:32.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.356+0000 7f9a492a7700 1 -- 172.21.15.57:0/2772493545 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a4408ad60 con 0x7f9a441249e0 2023-03-03T07:43:32.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.356+0000 7f9a2b7fe700 1 -- 172.21.15.57:0/2772493545 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42205+0+0 (secure 0 0 0) 0x7f9a3401a020 con 0x7f9a441249e0 2023-03-03T07:43:32.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.356+0000 7f9a2b7fe700 1 --2- 172.21.15.57:0/2772493545 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f9a30034840 0x7f9a30036cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:32.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.356+0000 7f9a2b7fe700 1 -- 172.21.15.57:0/2772493545 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2076+0+0 (secure 0 0 0) 0x7f9a34045a60 con 0x7f9a441249e0 2023-03-03T07:43:32.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.360+0000 7f9a427fc700 1 --2- 172.21.15.57:0/2772493545 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f9a30034840 0x7f9a30036cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:32.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.360+0000 7f9a427fc700 1 --2- 172.21.15.57:0/2772493545 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f9a30034840 0x7f9a30036cf0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9a38000c00 tx=0x7f9a38008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:32.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.364+0000 7f9a2b7fe700 1 -- 172.21.15.57:0/2772493545 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9a3401bb70 con 0x7f9a441249e0 2023-03-03T07:43:32.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.540+0000 7f9a492a7700 1 -- 172.21.15.57:0/2772493545 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9a44122080 con 0x7f9a441249e0 2023-03-03T07:43:32.547 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.540+0000 7f9a2b7fe700 1 -- 172.21.15.57:0/2772493545 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v12) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9a3401b340 con 0x7f9a441249e0 2023-03-03T07:43:32.547 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-03-03T07:43:32.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.544+0000 7f9a492a7700 1 -- 172.21.15.57:0/2772493545 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f9a30034840 msgr2=0x7f9a30036cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:32.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.544+0000 7f9a492a7700 1 --2- 172.21.15.57:0/2772493545 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f9a30034840 0x7f9a30036cf0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9a38000c00 tx=0x7f9a38008030 comp rx=0 tx=0).stop 2023-03-03T07:43:32.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.544+0000 7f9a492a7700 1 -- 172.21.15.57:0/2772493545 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a441249e0 msgr2=0x7f9a4411f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:32.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.544+0000 7f9a492a7700 1 --2- 172.21.15.57:0/2772493545 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a441249e0 0x7f9a4411f4c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9a3400c4d0 tx=0x7f9a3400c890 comp rx=0 tx=0).stop 2023-03-03T07:43:32.551 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.544+0000 7f9a492a7700 1 -- 172.21.15.57:0/2772493545 shutdown_connections 2023-03-03T07:43:32.551 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.544+0000 7f9a492a7700 1 --2- 172.21.15.57:0/2772493545 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f9a30034840 0x7f9a30036cf0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:32.551 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.544+0000 7f9a492a7700 1 --2- 172.21.15.57:0/2772493545 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a441249e0 0x7f9a4411f4c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:32.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.544+0000 7f9a492a7700 1 -- 172.21.15.57:0/2772493545 >> 172.21.15.57:0/2772493545 conn(0x7f9a44069f00 msgr2=0x7f9a44091f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:32.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.544+0000 7f9a492a7700 1 -- 172.21.15.57:0/2772493545 shutdown_connections 2023-03-03T07:43:32.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.544+0000 7f9a492a7700 1 -- 172.21.15.57:0/2772493545 wait complete. 2023-03-03T07:43:32.583 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-03T07:43:32.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.788+0000 7f92f5d69700 1 Processor -- start 2023-03-03T07:43:32.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.788+0000 7f92f5d69700 1 -- start start 2023-03-03T07:43:32.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.792+0000 7f92f5d69700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f92f0070360 0x7f92f0070730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:32.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.792+0000 7f92f5d69700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92f008e660 con 0x7f92f0127750 2023-03-03T07:43:32.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.792+0000 7f92f5d69700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92f0070c70 con 0x7f92f0070360 2023-03-03T07:43:32.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.792+0000 7f92e7fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f92f0127750 0x7f92f0127bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52402/0 (socket says 172.21.15.57:52402) 2023-03-03T07:43:32.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.792+0000 7f92e7fff700 1 -- 172.21.15.57:0/47171466 learned_addr learned my addr 172.21.15.57:0/47171466 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:43:32.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.792+0000 7f92f4d67700 1 --2- 172.21.15.57:0/47171466 >> v2:172.21.15.57:3300/0 conn(0x7f92f0070360 0x7f92f0070730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:32.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.792+0000 7f92e77fe700 1 -- 172.21.15.57:0/47171466 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 285878738 0 0) 0x7f92f008e660 con 0x7f92f0127750 2023-03-03T07:43:32.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.792+0000 7f92e77fe700 1 -- 172.21.15.57:0/47171466 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92d80035d0 con 0x7f92f0127750 2023-03-03T07:43:32.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.792+0000 7f92f4d67700 1 -- 172.21.15.57:0/47171466 >> v1:172.21.15.57:6789/0 conn(0x7f92f0127750 legacy=0x7f92f0127bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:32.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.792+0000 7f92f4d67700 1 -- 172.21.15.57:0/47171466 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f00715d0 con 0x7f92f0070360 2023-03-03T07:43:32.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.792+0000 7f92f4d67700 1 --2- 172.21.15.57:0/47171466 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92f0070360 0x7f92f0070730 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f92ec009de0 tx=0x7f92ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3470c332dca64d3 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:32.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.796+0000 7f92e77fe700 1 -- 172.21.15.57:0/47171466 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92ec00e070 con 0x7f92f0070360 2023-03-03T07:43:32.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.796+0000 7f92e77fe700 1 -- 172.21.15.57:0/47171466 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92ec003b70 con 0x7f92f0070360 2023-03-03T07:43:32.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.796+0000 7f92e77fe700 1 -- 172.21.15.57:0/47171466 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92ec003e50 con 0x7f92f0070360 2023-03-03T07:43:32.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.796+0000 7f92f5d69700 1 -- 172.21.15.57:0/47171466 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92f0070360 msgr2=0x7f92f0070730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:32.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.796+0000 7f92f5d69700 1 --2- 172.21.15.57:0/47171466 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92f0070360 0x7f92f0070730 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f92ec009de0 tx=0x7f92ec00b330 comp rx=0 tx=0).stop 2023-03-03T07:43:32.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.796+0000 7f92f5d69700 1 -- 172.21.15.57:0/47171466 shutdown_connections 2023-03-03T07:43:32.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.796+0000 7f92f5d69700 1 --2- 172.21.15.57:0/47171466 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92f0070360 0x7f92f0070730 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:32.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.796+0000 7f92f5d69700 1 -- 172.21.15.57:0/47171466 >> 172.21.15.57:0/47171466 conn(0x7f92f006ba10 msgr2=0x7f92f006de20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:32.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.796+0000 7f92f5d69700 1 -- 172.21.15.57:0/47171466 shutdown_connections 2023-03-03T07:43:32.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.796+0000 7f92f5d69700 1 -- 172.21.15.57:0/47171466 wait complete. 2023-03-03T07:43:32.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.800+0000 7f92f5d69700 1 Processor -- start 2023-03-03T07:43:32.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.800+0000 7f92f5d69700 1 -- start start 2023-03-03T07:43:32.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.800+0000 7f92f5d69700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92f0070360 0x7f92f01c01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:32.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.800+0000 7f92f5d69700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f01220f0 con 0x7f92f0070360 2023-03-03T07:43:32.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.800+0000 7f92f4d67700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92f0070360 0x7f92f01c01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:32.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.800+0000 7f92f4d67700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92f0070360 0x7f92f01c01a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33824/0 (socket says 172.21.15.57:33824) 2023-03-03T07:43:32.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.800+0000 7f92f4d67700 1 -- 172.21.15.57:0/1783693339 learned_addr learned my addr 172.21.15.57:0/1783693339 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:32.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.800+0000 7f92f4d67700 1 -- 172.21.15.57:0/1783693339 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92ec009a70 con 0x7f92f0070360 2023-03-03T07:43:32.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.800+0000 7f92f4d67700 1 --2- 172.21.15.57:0/1783693339 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92f0070360 0x7f92f01c01a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f92ec00b370 tx=0x7f92ec004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:32.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.804+0000 7f92e57fa700 1 -- 172.21.15.57:0/1783693339 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92ec0045c0 con 0x7f92f0070360 2023-03-03T07:43:32.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.804+0000 7f92e57fa700 1 -- 172.21.15.57:0/1783693339 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92ec004720 con 0x7f92f0070360 2023-03-03T07:43:32.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.804+0000 7f92f5d69700 1 -- 172.21.15.57:0/1783693339 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92f0128470 con 0x7f92f0070360 2023-03-03T07:43:32.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.804+0000 7f92e57fa700 1 -- 172.21.15.57:0/1783693339 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92ec012430 con 0x7f92f0070360 2023-03-03T07:43:32.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.804+0000 7f92f5d69700 1 -- 172.21.15.57:0/1783693339 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92f01282e0 con 0x7f92f0070360 2023-03-03T07:43:32.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.804+0000 7f92f5d69700 1 -- 172.21.15.57:0/1783693339 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92f012da80 con 0x7f92f0070360 2023-03-03T07:43:32.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.804+0000 7f92e57fa700 1 -- 172.21.15.57:0/1783693339 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42205+0+0 (secure 0 0 0) 0x7f92ec012620 con 0x7f92f0070360 2023-03-03T07:43:32.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.808+0000 7f92e57fa700 1 --2- 172.21.15.57:0/1783693339 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f92dc0347f0 0x7f92dc036ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:32.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.808+0000 7f92e57fa700 1 -- 172.21.15.57:0/1783693339 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2076+0+0 (secure 0 0 0) 0x7f92ec0481c0 con 0x7f92f0070360 2023-03-03T07:43:32.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.808+0000 7f92e7fff700 1 --2- 172.21.15.57:0/1783693339 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f92dc0347f0 0x7f92dc036ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:32.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.808+0000 7f92e7fff700 1 --2- 172.21.15.57:0/1783693339 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f92dc0347f0 0x7f92dc036ca0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f92e0000f60 tx=0x7f92e00010a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:32.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.816+0000 7f92e57fa700 1 -- 172.21.15.57:0/1783693339 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f92ec02de00 con 0x7f92f0070360 2023-03-03T07:43:32.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.992+0000 7f92f5d69700 1 -- 172.21.15.57:0/1783693339 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f92f00619b0 con 0x7f92f0070360 2023-03-03T07:43:33.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.996+0000 7f92e57fa700 1 -- 172.21.15.57:0/1783693339 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v12) v1 ==== 92+0+10 (secure 0 0 0) 0x7f92ec02d3a0 con 0x7f92f0070360 2023-03-03T07:43:33.000 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2023-03-03T07:43:33.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.996+0000 7f92f5d69700 1 -- 172.21.15.57:0/1783693339 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f92dc0347f0 msgr2=0x7f92dc036ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:33.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.996+0000 7f92f5d69700 1 --2- 172.21.15.57:0/1783693339 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f92dc0347f0 0x7f92dc036ca0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f92e0000f60 tx=0x7f92e00010a0 comp rx=0 tx=0).stop 2023-03-03T07:43:33.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.996+0000 7f92f5d69700 1 -- 172.21.15.57:0/1783693339 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92f0070360 msgr2=0x7f92f01c01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:33.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:32.996+0000 7f92f5d69700 1 --2- 172.21.15.57:0/1783693339 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92f0070360 0x7f92f01c01a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f92ec00b370 tx=0x7f92ec004af0 comp rx=0 tx=0).stop 2023-03-03T07:43:33.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.000+0000 7f92f5d69700 1 -- 172.21.15.57:0/1783693339 shutdown_connections 2023-03-03T07:43:33.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.000+0000 7f92f5d69700 1 --2- 172.21.15.57:0/1783693339 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f92dc0347f0 0x7f92dc036ca0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:33.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.000+0000 7f92f5d69700 1 --2- 172.21.15.57:0/1783693339 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92f0070360 0x7f92f01c01a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:33.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.000+0000 7f92f5d69700 1 -- 172.21.15.57:0/1783693339 >> 172.21.15.57:0/1783693339 conn(0x7f92f006ba10 msgr2=0x7f92f0097110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:33.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.000+0000 7f92f5d69700 1 -- 172.21.15.57:0/1783693339 shutdown_connections 2023-03-03T07:43:33.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.000+0000 7f92f5d69700 1 -- 172.21.15.57:0/1783693339 wait complete. 2023-03-03T07:43:33.047 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-03-03T07:43:33.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.248+0000 7f05813cb700 1 Processor -- start 2023-03-03T07:43:33.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.248+0000 7f05813cb700 1 -- start start 2023-03-03T07:43:33.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.248+0000 7f05813cb700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f057c12efb0 0x7f057c131390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:33.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.248+0000 7f05813cb700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f057c0711c0 con 0x7f057c0914a0 2023-03-03T07:43:33.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.248+0000 7f05813cb700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f057c0713f0 con 0x7f057c12efb0 2023-03-03T07:43:33.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.248+0000 7f057a7fc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f057c12efb0 0x7f057c131390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:33.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.248+0000 7f057affd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f057c0914a0 0x7f057c091870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52418/0 (socket says 172.21.15.57:52418) 2023-03-03T07:43:33.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.248+0000 7f057affd700 1 -- 172.21.15.57:0/213438813 learned_addr learned my addr 172.21.15.57:0/213438813 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:43:33.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.248+0000 7f057a7fc700 1 -- 172.21.15.57:0/213438813 >> v1:172.21.15.57:6789/0 conn(0x7f057c0914a0 legacy=0x7f057c091870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:33.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.248+0000 7f057a7fc700 1 -- 172.21.15.57:0/213438813 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f057c071700 con 0x7f057c12efb0 2023-03-03T07:43:33.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.252+0000 7f057a7fc700 1 --2- 172.21.15.57:0/213438813 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f057c12efb0 0x7f057c131390 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f05700099e0 tx=0x7f0570009cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21e2ce0adaff9497 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:33.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.252+0000 7f0579ffb700 1 -- 172.21.15.57:0/213438813 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0570004160 con 0x7f057c12efb0 2023-03-03T07:43:33.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.252+0000 7f0579ffb700 1 -- 172.21.15.57:0/213438813 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05700042c0 con 0x7f057c12efb0 2023-03-03T07:43:33.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.252+0000 7f0579ffb700 1 -- 172.21.15.57:0/213438813 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0570004580 con 0x7f057c12efb0 2023-03-03T07:43:33.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.252+0000 7f05813cb700 1 -- 172.21.15.57:0/213438813 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f057c12efb0 msgr2=0x7f057c131390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:33.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.252+0000 7f05813cb700 1 --2- 172.21.15.57:0/213438813 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f057c12efb0 0x7f057c131390 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f05700099e0 tx=0x7f0570009cf0 comp rx=0 tx=0).stop 2023-03-03T07:43:33.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.252+0000 7f05813cb700 1 -- 172.21.15.57:0/213438813 shutdown_connections 2023-03-03T07:43:33.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.252+0000 7f05813cb700 1 --2- 172.21.15.57:0/213438813 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f057c12efb0 0x7f057c131390 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:33.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.252+0000 7f05813cb700 1 -- 172.21.15.57:0/213438813 >> 172.21.15.57:0/213438813 conn(0x7f057c069f00 msgr2=0x7f057c06a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:33.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.252+0000 7f05813cb700 1 -- 172.21.15.57:0/213438813 shutdown_connections 2023-03-03T07:43:33.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.252+0000 7f05813cb700 1 -- 172.21.15.57:0/213438813 wait complete. 2023-03-03T07:43:33.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.256+0000 7f05813cb700 1 Processor -- start 2023-03-03T07:43:33.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.256+0000 7f05813cb700 1 -- start start 2023-03-03T07:43:33.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.256+0000 7f05813cb700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f057c0914a0 0x7f057c08f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:33.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.256+0000 7f05813cb700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f057c090db0 con 0x7f057c0914a0 2023-03-03T07:43:33.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.256+0000 7f057affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f057c0914a0 0x7f057c08f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:33.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.256+0000 7f057affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f057c0914a0 0x7f057c08f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33852/0 (socket says 172.21.15.57:33852) 2023-03-03T07:43:33.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.256+0000 7f057affd700 1 -- 172.21.15.57:0/1142801711 learned_addr learned my addr 172.21.15.57:0/1142801711 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:33.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.260+0000 7f057affd700 1 -- 172.21.15.57:0/1142801711 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05700094b0 con 0x7f057c0914a0 2023-03-03T07:43:33.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.260+0000 7f057affd700 1 --2- 172.21.15.57:0/1142801711 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f057c0914a0 0x7f057c08f470 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f056c00c480 tx=0x7f056c00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:33.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.260+0000 7f05637fe700 1 -- 172.21.15.57:0/1142801711 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f056c005cc0 con 0x7f057c0914a0 2023-03-03T07:43:33.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.260+0000 7f05637fe700 1 -- 172.21.15.57:0/1142801711 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f056c005e20 con 0x7f057c0914a0 2023-03-03T07:43:33.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.260+0000 7f05813cb700 1 -- 172.21.15.57:0/1142801711 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f057c131a60 con 0x7f057c0914a0 2023-03-03T07:43:33.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.260+0000 7f05637fe700 1 -- 172.21.15.57:0/1142801711 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f056c0049c0 con 0x7f057c0914a0 2023-03-03T07:43:33.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.260+0000 7f05813cb700 1 -- 172.21.15.57:0/1142801711 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f057c1318d0 con 0x7f057c0914a0 2023-03-03T07:43:33.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.260+0000 7f05813cb700 1 -- 172.21.15.57:0/1142801711 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f057c131bf0 con 0x7f057c0914a0 2023-03-03T07:43:33.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.264+0000 7f05637fe700 1 -- 172.21.15.57:0/1142801711 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42205+0+0 (secure 0 0 0) 0x7f056c010070 con 0x7f057c0914a0 2023-03-03T07:43:33.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.264+0000 7f05637fe700 1 --2- 172.21.15.57:0/1142801711 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f0568034840 0x7f0568036cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:33.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.264+0000 7f05637fe700 1 -- 172.21.15.57:0/1142801711 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2076+0+0 (secure 0 0 0) 0x7f056c045510 con 0x7f057c0914a0 2023-03-03T07:43:33.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.264+0000 7f057a7fc700 1 --2- 172.21.15.57:0/1142801711 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f0568034840 0x7f0568036cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:33.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.264+0000 7f057a7fc700 1 --2- 172.21.15.57:0/1142801711 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f0568034840 0x7f0568036cf0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f05700099e0 tx=0x7f0570008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:33.274 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.268+0000 7f05637fe700 1 -- 172.21.15.57:0/1142801711 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f056c004c30 con 0x7f057c0914a0 2023-03-03T07:43:33.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.440+0000 7f05813cb700 1 -- 172.21.15.57:0/1142801711 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f057c04eff0 con 0x7f057c0914a0 2023-03-03T07:43:33.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.440+0000 7f05637fe700 1 -- 172.21.15.57:0/1142801711 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v12) v1 ==== 84+0+126 (secure 0 0 0) 0x7f056c0113a0 con 0x7f057c0914a0 2023-03-03T07:43:33.448 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-03T07:43:33.448 INFO:teuthology.orchestra.run.smithi057.stdout:[ 2023-03-03T07:43:33.448 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-03-03T07:43:33.448 INFO:teuthology.orchestra.run.smithi057.stdout: "poolnum": 1, 2023-03-03T07:43:33.449 INFO:teuthology.orchestra.run.smithi057.stdout: "poolname": ".mgr" 2023-03-03T07:43:33.449 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-03-03T07:43:33.449 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-03-03T07:43:33.449 INFO:teuthology.orchestra.run.smithi057.stdout: "poolnum": 2, 2023-03-03T07:43:33.449 INFO:teuthology.orchestra.run.smithi057.stdout: "poolname": "rbd" 2023-03-03T07:43:33.449 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-03T07:43:33.450 INFO:teuthology.orchestra.run.smithi057.stdout:] 2023-03-03T07:43:33.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.444+0000 7f05813cb700 1 -- 172.21.15.57:0/1142801711 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f0568034840 msgr2=0x7f0568036cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:33.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.444+0000 7f05813cb700 1 --2- 172.21.15.57:0/1142801711 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f0568034840 0x7f0568036cf0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f05700099e0 tx=0x7f0570008030 comp rx=0 tx=0).stop 2023-03-03T07:43:33.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.444+0000 7f05813cb700 1 -- 172.21.15.57:0/1142801711 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f057c0914a0 msgr2=0x7f057c08f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:33.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.444+0000 7f05813cb700 1 --2- 172.21.15.57:0/1142801711 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f057c0914a0 0x7f057c08f470 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f056c00c480 tx=0x7f056c00c840 comp rx=0 tx=0).stop 2023-03-03T07:43:33.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.444+0000 7f05813cb700 1 -- 172.21.15.57:0/1142801711 shutdown_connections 2023-03-03T07:43:33.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.444+0000 7f05813cb700 1 --2- 172.21.15.57:0/1142801711 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f0568034840 0x7f0568036cf0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:33.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.444+0000 7f05813cb700 1 --2- 172.21.15.57:0/1142801711 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f057c0914a0 0x7f057c08f470 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:33.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.444+0000 7f05813cb700 1 -- 172.21.15.57:0/1142801711 >> 172.21.15.57:0/1142801711 conn(0x7f057c069f00 msgr2=0x7f057c12f760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:33.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.444+0000 7f05813cb700 1 -- 172.21.15.57:0/1142801711 shutdown_connections 2023-03-03T07:43:33.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.444+0000 7f05813cb700 1 -- 172.21.15.57:0/1142801711 wait complete. 2023-03-03T07:43:33.484 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-03-03T07:43:33.484 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-03-03T07:43:33.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.688+0000 7fef5759e700 1 Processor -- start 2023-03-03T07:43:33.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.688+0000 7fef5759e700 1 -- start start 2023-03-03T07:43:33.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.692+0000 7fef5759e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fef5808f810 0x7fef5812d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:33.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.692+0000 7fef5759e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef580913b0 con 0x7fef5808ed30 2023-03-03T07:43:33.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.692+0000 7fef5759e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef58090350 con 0x7fef5808f810 2023-03-03T07:43:33.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.692+0000 7fef55d9b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fef5808f810 0x7fef5812d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:33.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.692+0000 7fef55d9b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fef5808f810 0x7fef5812d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33856/0 (socket says 172.21.15.57:33856) 2023-03-03T07:43:33.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.692+0000 7fef55d9b700 1 -- 172.21.15.57:0/4232893805 learned_addr learned my addr 172.21.15.57:0/4232893805 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:33.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.692+0000 7fef55d9b700 1 -- 172.21.15.57:0/4232893805 >> v1:172.21.15.57:6789/0 conn(0x7fef5808ed30 legacy=0x7fef5808f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:33.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.692+0000 7fef55d9b700 1 -- 172.21.15.57:0/4232893805 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef580910a0 con 0x7fef5808f810 2023-03-03T07:43:33.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.692+0000 7fef55d9b700 1 --2- 172.21.15.57:0/4232893805 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef5808f810 0x7fef5812d4f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fef4c009890 tx=0x7fef4c009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eb425c8af6a3f41 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:33.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.692+0000 7fef5559a700 1 -- 172.21.15.57:0/4232893805 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef4c004160 con 0x7fef5808f810 2023-03-03T07:43:33.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.692+0000 7fef5559a700 1 -- 172.21.15.57:0/4232893805 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4c0042c0 con 0x7fef5808f810 2023-03-03T07:43:33.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.692+0000 7fef5559a700 1 -- 172.21.15.57:0/4232893805 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef4c004580 con 0x7fef5808f810 2023-03-03T07:43:33.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.696+0000 7fef5759e700 1 -- 172.21.15.57:0/4232893805 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef5808f810 msgr2=0x7fef5812d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:33.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.696+0000 7fef5759e700 1 --2- 172.21.15.57:0/4232893805 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef5808f810 0x7fef5812d4f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fef4c009890 tx=0x7fef4c009ba0 comp rx=0 tx=0).stop 2023-03-03T07:43:33.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.696+0000 7fef5759e700 1 -- 172.21.15.57:0/4232893805 shutdown_connections 2023-03-03T07:43:33.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.696+0000 7fef5759e700 1 --2- 172.21.15.57:0/4232893805 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef5808f810 0x7fef5812d4f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:33.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.696+0000 7fef5759e700 1 -- 172.21.15.57:0/4232893805 >> 172.21.15.57:0/4232893805 conn(0x7fef5806d940 msgr2=0x7fef5806fd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:33.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.696+0000 7fef5759e700 1 -- 172.21.15.57:0/4232893805 shutdown_connections 2023-03-03T07:43:33.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.696+0000 7fef5759e700 1 -- 172.21.15.57:0/4232893805 wait complete. 2023-03-03T07:43:33.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.700+0000 7fef5759e700 1 Processor -- start 2023-03-03T07:43:33.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.700+0000 7fef5759e700 1 -- start start 2023-03-03T07:43:33.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.700+0000 7fef5759e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef5808ed30 0x7fef5812d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:33.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.700+0000 7fef5759e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5812c970 con 0x7fef5808ed30 2023-03-03T07:43:33.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.700+0000 7fef5659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef5808ed30 0x7fef5812d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:33.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.700+0000 7fef5659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef5808ed30 0x7fef5812d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33870/0 (socket says 172.21.15.57:33870) 2023-03-03T07:43:33.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.700+0000 7fef5659c700 1 -- 172.21.15.57:0/70279850 learned_addr learned my addr 172.21.15.57:0/70279850 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:33.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.700+0000 7fef5659c700 1 -- 172.21.15.57:0/70279850 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef4c009570 con 0x7fef5808ed30 2023-03-03T07:43:33.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.700+0000 7fef5659c700 1 --2- 172.21.15.57:0/70279850 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef5808ed30 0x7fef5812d4a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fef4800c480 tx=0x7fef4800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:33.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.700+0000 7fef46ffd700 1 -- 172.21.15.57:0/70279850 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef48005150 con 0x7fef5808ed30 2023-03-03T07:43:33.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.700+0000 7fef46ffd700 1 -- 172.21.15.57:0/70279850 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef480052b0 con 0x7fef5808ed30 2023-03-03T07:43:33.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.700+0000 7fef46ffd700 1 -- 172.21.15.57:0/70279850 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef48005590 con 0x7fef5808ed30 2023-03-03T07:43:33.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.700+0000 7fef5759e700 1 -- 172.21.15.57:0/70279850 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef5812da30 con 0x7fef5808ed30 2023-03-03T07:43:33.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.704+0000 7fef5759e700 1 -- 172.21.15.57:0/70279850 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef5809b1b0 con 0x7fef5808ed30 2023-03-03T07:43:33.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.704+0000 7fef5759e700 1 -- 172.21.15.57:0/70279850 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef5812dbc0 con 0x7fef5808ed30 2023-03-03T07:43:33.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.704+0000 7fef46ffd700 1 -- 172.21.15.57:0/70279850 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42205+0+0 (secure 0 0 0) 0x7fef48010050 con 0x7fef5808ed30 2023-03-03T07:43:33.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.704+0000 7fef46ffd700 1 --2- 172.21.15.57:0/70279850 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fef38034840 0x7fef38036cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:33.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.704+0000 7fef46ffd700 1 -- 172.21.15.57:0/70279850 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2076+0+0 (secure 0 0 0) 0x7fef48044f40 con 0x7fef5808ed30 2023-03-03T07:43:33.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.708+0000 7fef55d9b700 1 --2- 172.21.15.57:0/70279850 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fef38034840 0x7fef38036cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:33.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.708+0000 7fef55d9b700 1 --2- 172.21.15.57:0/70279850 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fef38034840 0x7fef38036cf0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fef4c009fd0 tx=0x7fef4c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:33.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.712+0000 7fef46ffd700 1 -- 172.21.15.57:0/70279850 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fef480106f0 con 0x7fef5808ed30 2023-03-03T07:43:33.819 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:43:33.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:33.888+0000 7fef5759e700 1 -- 172.21.15.57:0/70279850 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fef580619b0 con 0x7fef5808ed30 2023-03-03T07:43:34.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:34.852+0000 7fef46ffd700 1 -- 172.21.15.57:0/70279850 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v13) v1 ==== 138+0+0 (secure 0 0 0) 0x7fef4801a3a0 con 0x7fef5808ed30 2023-03-03T07:43:34.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:34.860+0000 7fef5759e700 1 -- 172.21.15.57:0/70279850 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fef38034840 msgr2=0x7fef38036cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:34.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:34.860+0000 7fef5759e700 1 --2- 172.21.15.57:0/70279850 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fef38034840 0x7fef38036cf0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fef4c009fd0 tx=0x7fef4c008030 comp rx=0 tx=0).stop 2023-03-03T07:43:34.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:34.860+0000 7fef5759e700 1 -- 172.21.15.57:0/70279850 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef5808ed30 msgr2=0x7fef5812d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:34.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:34.860+0000 7fef5759e700 1 --2- 172.21.15.57:0/70279850 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef5808ed30 0x7fef5812d4a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fef4800c480 tx=0x7fef4800c840 comp rx=0 tx=0).stop 2023-03-03T07:43:34.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:34.860+0000 7fef5759e700 1 -- 172.21.15.57:0/70279850 shutdown_connections 2023-03-03T07:43:34.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:34.860+0000 7fef5759e700 1 --2- 172.21.15.57:0/70279850 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fef38034840 0x7fef38036cf0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:34.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:34.860+0000 7fef5759e700 1 --2- 172.21.15.57:0/70279850 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef5808ed30 0x7fef5812d4a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:34.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:34.860+0000 7fef5759e700 1 -- 172.21.15.57:0/70279850 >> 172.21.15.57:0/70279850 conn(0x7fef5806d940 msgr2=0x7fef58070670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:34.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:34.860+0000 7fef5759e700 1 -- 172.21.15.57:0/70279850 shutdown_connections 2023-03-03T07:43:34.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:34.860+0000 7fef5759e700 1 -- 172.21.15.57:0/70279850 wait complete. 2023-03-03T07:43:34.870 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' created 2023-03-03T07:43:34.897 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-03-03T07:43:35.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:35.112+0000 7f479d876700 1 Processor -- start 2023-03-03T07:43:35.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:35.112+0000 7f479d876700 1 -- start start 2023-03-03T07:43:35.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:35.116+0000 7f479d876700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4798123af0 0x7f4798123ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:35.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:35.116+0000 7f479d876700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47981235a0 con 0x7f479808af90 2023-03-03T07:43:35.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:35.116+0000 7f479d876700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4798124400 con 0x7f4798123af0 2023-03-03T07:43:35.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:35.116+0000 7f479c874700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4798123af0 0x7f4798123ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:35.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:35.116+0000 7f479c874700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4798123af0 0x7f4798123ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33874/0 (socket says 172.21.15.57:33874) 2023-03-03T07:43:35.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:35.116+0000 7f479c874700 1 -- 172.21.15.57:0/2512102397 learned_addr learned my addr 172.21.15.57:0/2512102397 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:35.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:35.116+0000 7f479c874700 1 -- 172.21.15.57:0/2512102397 >> v1:172.21.15.57:6789/0 conn(0x7f479808af90 legacy=0x7f479808b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:35.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:35.116+0000 7f479c874700 1 -- 172.21.15.57:0/2512102397 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f479808c2a0 con 0x7f4798123af0 2023-03-03T07:43:35.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:35.120+0000 7f479c874700 1 --2- 172.21.15.57:0/2512102397 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4798123af0 0x7f4798123ec0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f478c009890 tx=0x7f478c009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f055b6df555f03c4 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:35.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:35.120+0000 7f47977fe700 1 -- 172.21.15.57:0/2512102397 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f478c004160 con 0x7f4798123af0 2023-03-03T07:43:35.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:35.120+0000 7f47977fe700 1 -- 172.21.15.57:0/2512102397 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478c0042c0 con 0x7f4798123af0 2023-03-03T07:43:35.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:35.120+0000 7f47977fe700 1 -- 172.21.15.57:0/2512102397 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f478c004580 con 0x7f4798123af0 2023-03-03T07:43:35.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:35.120+0000 7f479d876700 1 -- 172.21.15.57:0/2512102397 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4798123af0 msgr2=0x7f4798123ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:35.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:35.120+0000 7f479d876700 1 --2- 172.21.15.57:0/2512102397 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4798123af0 0x7f4798123ec0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f478c009890 tx=0x7f478c009ba0 comp rx=0 tx=0).stop 2023-03-03T07:43:35.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:35.120+0000 7f479d876700 1 -- 172.21.15.57:0/2512102397 shutdown_connections 2023-03-03T07:43:35.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:35.120+0000 7f479d876700 1 --2- 172.21.15.57:0/2512102397 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4798123af0 0x7f4798123ec0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:35.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:35.120+0000 7f479d876700 1 -- 172.21.15.57:0/2512102397 >> 172.21.15.57:0/2512102397 conn(0x7f479806dff0 msgr2=0x7f4798070400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:35.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:35.120+0000 7f479d876700 1 -- 172.21.15.57:0/2512102397 shutdown_connections 2023-03-03T07:43:35.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:35.120+0000 7f479d876700 1 -- 172.21.15.57:0/2512102397 wait complete. 2023-03-03T07:43:35.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:35.124+0000 7f479d876700 1 Processor -- start 2023-03-03T07:43:35.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:35.124+0000 7f479d876700 1 -- start start 2023-03-03T07:43:35.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:35.124+0000 7f479d876700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f479808af90 0x7f4798122b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:35.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:35.124+0000 7f479d876700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479808deb0 con 0x7f479808af90 2023-03-03T07:43:35.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:35.124+0000 7f479c874700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f479808af90 0x7f4798122b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:35.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:35.124+0000 7f479c874700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f479808af90 0x7f4798122b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33880/0 (socket says 172.21.15.57:33880) 2023-03-03T07:43:35.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:35.124+0000 7f479c874700 1 -- 172.21.15.57:0/1584886834 learned_addr learned my addr 172.21.15.57:0/1584886834 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:35.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:35.124+0000 7f479c874700 1 -- 172.21.15.57:0/1584886834 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f478c009570 con 0x7f479808af90 2023-03-03T07:43:35.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:35.124+0000 7f479c874700 1 --2- 172.21.15.57:0/1584886834 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f479808af90 0x7f4798122b90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f478c009fd0 tx=0x7f478c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:35.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:35.128+0000 7f47957fa700 1 -- 172.21.15.57:0/1584886834 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f478c00b670 con 0x7f479808af90 2023-03-03T07:43:35.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:35.128+0000 7f47957fa700 1 -- 172.21.15.57:0/1584886834 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478c00b7d0 con 0x7f479808af90 2023-03-03T07:43:35.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:35.128+0000 7f47957fa700 1 -- 172.21.15.57:0/1584886834 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f478c00ba70 con 0x7f479808af90 2023-03-03T07:43:35.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:35.128+0000 7f479d876700 1 -- 172.21.15.57:0/1584886834 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f479808bb40 con 0x7f479808af90 2023-03-03T07:43:35.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:35.128+0000 7f479d876700 1 -- 172.21.15.57:0/1584886834 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f479808c5b0 con 0x7f479808af90 2023-03-03T07:43:35.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:35.128+0000 7f479d876700 1 -- 172.21.15.57:0/1584886834 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f479808bcd0 con 0x7f479808af90 2023-03-03T07:43:35.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:35.128+0000 7f47957fa700 1 -- 172.21.15.57:0/1584886834 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42205+0+0 (secure 0 0 0) 0x7f478c017020 con 0x7f479808af90 2023-03-03T07:43:35.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:35.132+0000 7f47957fa700 1 --2- 172.21.15.57:0/1584886834 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f477c034840 0x7f477c036cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:35.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:35.132+0000 7f47957fa700 1 -- 172.21.15.57:0/1584886834 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2446+0+0 (secure 0 0 0) 0x7f478c047800 con 0x7f479808af90 2023-03-03T07:43:35.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:35.132+0000 7f4797fff700 1 --2- 172.21.15.57:0/1584886834 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f477c034840 0x7f477c036cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:35.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:35.132+0000 7f4797fff700 1 --2- 172.21.15.57:0/1584886834 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f477c034840 0x7f477c036cf0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4784001620 tx=0x7f4784007b00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:35.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:35.140+0000 7f47957fa700 1 -- 172.21.15.57:0/1584886834 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f478c00bbd0 con 0x7f479808af90 2023-03-03T07:43:35.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:35.312+0000 7f479d876700 1 -- 172.21.15.57:0/1584886834 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f479808e000 con 0x7f479808af90 2023-03-03T07:43:35.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:35.860+0000 7f47957fa700 1 -- 172.21.15.57:0/1584886834 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v14) v1 ==== 170+0+0 (secure 0 0 0) 0x7f478c02cbe0 con 0x7f479808af90 2023-03-03T07:43:35.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:35.868+0000 7f479d876700 1 -- 172.21.15.57:0/1584886834 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f477c034840 msgr2=0x7f477c036cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:35.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:35.868+0000 7f479d876700 1 --2- 172.21.15.57:0/1584886834 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f477c034840 0x7f477c036cf0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4784001620 tx=0x7f4784007b00 comp rx=0 tx=0).stop 2023-03-03T07:43:35.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:35.868+0000 7f479d876700 1 -- 172.21.15.57:0/1584886834 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f479808af90 msgr2=0x7f4798122b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:35.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:35.868+0000 7f479d876700 1 --2- 172.21.15.57:0/1584886834 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f479808af90 0x7f4798122b90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f478c009fd0 tx=0x7f478c004770 comp rx=0 tx=0).stop 2023-03-03T07:43:35.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:35.868+0000 7f479d876700 1 -- 172.21.15.57:0/1584886834 shutdown_connections 2023-03-03T07:43:35.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:35.868+0000 7f479d876700 1 --2- 172.21.15.57:0/1584886834 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f477c034840 0x7f477c036cf0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:35.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:35.868+0000 7f479d876700 1 --2- 172.21.15.57:0/1584886834 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f479808af90 0x7f4798122b90 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:35.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:35.868+0000 7f479d876700 1 -- 172.21.15.57:0/1584886834 >> 172.21.15.57:0/1584886834 conn(0x7f479806dff0 msgr2=0x7f479806f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:35.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:35.868+0000 7f479d876700 1 -- 172.21.15.57:0/1584886834 shutdown_connections 2023-03-03T07:43:35.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:35.868+0000 7f479d876700 1 -- 172.21.15.57:0/1584886834 wait complete. 2023-03-03T07:43:35.878 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' created 2023-03-03T07:43:35.909 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-03-03T07:43:36.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.112+0000 7f95756cf700 1 Processor -- start 2023-03-03T07:43:36.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.112+0000 7f95756cf700 1 -- start start 2023-03-03T07:43:36.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.116+0000 7f95756cf700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f95701286b0 0x7f957012aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:36.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.116+0000 7f95756cf700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95701124f0 con 0x7f9570124710 2023-03-03T07:43:36.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.116+0000 7f95756cf700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9570111540 con 0x7f95701286b0 2023-03-03T07:43:36.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.116+0000 7f956e7fc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f95701286b0 0x7f957012aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:36.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.116+0000 7f956effd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f9570124710 0x7f9570124ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52456/0 (socket says 172.21.15.57:52456) 2023-03-03T07:43:36.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.116+0000 7f956e7fc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f95701286b0 0x7f957012aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33894/0 (socket says 172.21.15.57:33894) 2023-03-03T07:43:36.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.116+0000 7f956effd700 1 -- 172.21.15.57:0/3374971469 learned_addr learned my addr 172.21.15.57:0/3374971469 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:43:36.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.116+0000 7f956e7fc700 1 -- 172.21.15.57:0/3374971469 >> v1:172.21.15.57:6789/0 conn(0x7f9570124710 legacy=0x7f9570124ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:36.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.116+0000 7f956e7fc700 1 -- 172.21.15.57:0/3374971469 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95701231b0 con 0x7f95701286b0 2023-03-03T07:43:36.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.116+0000 7f956e7fc700 1 --2- 172.21.15.57:0/3374971469 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95701286b0 0x7f957012aa90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f95640097d0 tx=0x7f9564009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b43e3c7df2fefe7 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:36.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.116+0000 7f956dffb700 1 -- 172.21.15.57:0/3374971469 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f95640041c0 con 0x7f95701286b0 2023-03-03T07:43:36.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.116+0000 7f956dffb700 1 -- 172.21.15.57:0/3374971469 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9564004320 con 0x7f95701286b0 2023-03-03T07:43:36.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.116+0000 7f956dffb700 1 -- 172.21.15.57:0/3374971469 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f95640036c0 con 0x7f95701286b0 2023-03-03T07:43:36.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.120+0000 7f95756cf700 1 -- 172.21.15.57:0/3374971469 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95701286b0 msgr2=0x7f957012aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:36.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.120+0000 7f95756cf700 1 --2- 172.21.15.57:0/3374971469 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95701286b0 0x7f957012aa90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f95640097d0 tx=0x7f9564009ae0 comp rx=0 tx=0).stop 2023-03-03T07:43:36.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.120+0000 7f95756cf700 1 -- 172.21.15.57:0/3374971469 shutdown_connections 2023-03-03T07:43:36.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.120+0000 7f95756cf700 1 --2- 172.21.15.57:0/3374971469 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95701286b0 0x7f957012aa90 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:36.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.120+0000 7f95756cf700 1 -- 172.21.15.57:0/3374971469 >> 172.21.15.57:0/3374971469 conn(0x7f9570071420 msgr2=0x7f9570069f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:36.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.120+0000 7f95756cf700 1 -- 172.21.15.57:0/3374971469 shutdown_connections 2023-03-03T07:43:36.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.120+0000 7f95756cf700 1 -- 172.21.15.57:0/3374971469 wait complete. 2023-03-03T07:43:36.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.124+0000 7f95756cf700 1 Processor -- start 2023-03-03T07:43:36.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.124+0000 7f95756cf700 1 -- start start 2023-03-03T07:43:36.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.124+0000 7f95756cf700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9570124710 0x7f9570112720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:36.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.124+0000 7f95756cf700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f957011f100 con 0x7f9570124710 2023-03-03T07:43:36.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.124+0000 7f956effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9570124710 0x7f9570112720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:36.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.124+0000 7f956effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9570124710 0x7f9570112720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33900/0 (socket says 172.21.15.57:33900) 2023-03-03T07:43:36.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.124+0000 7f956effd700 1 -- 172.21.15.57:0/451762507 learned_addr learned my addr 172.21.15.57:0/451762507 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:36.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.124+0000 7f956effd700 1 -- 172.21.15.57:0/451762507 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95640094b0 con 0x7f9570124710 2023-03-03T07:43:36.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.124+0000 7f956effd700 1 --2- 172.21.15.57:0/451762507 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9570124710 0x7f9570112720 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f956000c4a0 tx=0x7f956000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:36.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.124+0000 7f95577fe700 1 -- 172.21.15.57:0/451762507 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9560005cc0 con 0x7f9570124710 2023-03-03T07:43:36.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.124+0000 7f95577fe700 1 -- 172.21.15.57:0/451762507 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9560005e20 con 0x7f9570124710 2023-03-03T07:43:36.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.124+0000 7f95577fe700 1 -- 172.21.15.57:0/451762507 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9560007200 con 0x7f9570124710 2023-03-03T07:43:36.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.124+0000 7f95756cf700 1 -- 172.21.15.57:0/451762507 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f957006da80 con 0x7f9570124710 2023-03-03T07:43:36.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.128+0000 7f95756cf700 1 -- 172.21.15.57:0/451762507 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f957006d8f0 con 0x7f9570124710 2023-03-03T07:43:36.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.128+0000 7f95756cf700 1 -- 172.21.15.57:0/451762507 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f957006dc10 con 0x7f9570124710 2023-03-03T07:43:36.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.128+0000 7f95577fe700 1 -- 172.21.15.57:0/451762507 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42205+0+0 (secure 0 0 0) 0x7f9560019030 con 0x7f9570124710 2023-03-03T07:43:36.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.128+0000 7f95577fe700 1 --2- 172.21.15.57:0/451762507 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f955c034840 0x7f955c036cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:36.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.128+0000 7f95577fe700 1 -- 172.21.15.57:0/451762507 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2828+0+0 (secure 0 0 0) 0x7f9560045430 con 0x7f9570124710 2023-03-03T07:43:36.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.132+0000 7f956e7fc700 1 --2- 172.21.15.57:0/451762507 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f955c034840 0x7f955c036cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:36.137 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.132+0000 7f956e7fc700 1 --2- 172.21.15.57:0/451762507 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f955c034840 0x7f955c036cf0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9570066da0 tx=0x7f9564010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:36.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.140+0000 7f95577fe700 1 -- 172.21.15.57:0/451762507 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9560011540 con 0x7f9570124710 2023-03-03T07:43:36.355 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.348+0000 7f95756cf700 1 -- 172.21.15.57:0/451762507 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f9570114440 con 0x7f9570124710 2023-03-03T07:43:36.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.364+0000 7f95577fe700 1 -- 172.21.15.57:0/451762507 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v3) v1 ==== 172+0+0 (secure 0 0 0) 0x7f9560017030 con 0x7f9570124710 2023-03-03T07:43:36.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.368+0000 7f95756cf700 1 -- 172.21.15.57:0/451762507 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f955c034840 msgr2=0x7f955c036cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:36.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.368+0000 7f95756cf700 1 --2- 172.21.15.57:0/451762507 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f955c034840 0x7f955c036cf0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9570066da0 tx=0x7f9564010000 comp rx=0 tx=0).stop 2023-03-03T07:43:36.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.368+0000 7f95756cf700 1 -- 172.21.15.57:0/451762507 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9570124710 msgr2=0x7f9570112720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:36.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.368+0000 7f95756cf700 1 --2- 172.21.15.57:0/451762507 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9570124710 0x7f9570112720 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f956000c4a0 tx=0x7f956000c860 comp rx=0 tx=0).stop 2023-03-03T07:43:36.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.368+0000 7f95756cf700 1 -- 172.21.15.57:0/451762507 shutdown_connections 2023-03-03T07:43:36.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.368+0000 7f95756cf700 1 --2- 172.21.15.57:0/451762507 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f955c034840 0x7f955c036cf0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:36.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.368+0000 7f95756cf700 1 --2- 172.21.15.57:0/451762507 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9570124710 0x7f9570112720 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:36.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.368+0000 7f95756cf700 1 -- 172.21.15.57:0/451762507 >> 172.21.15.57:0/451762507 conn(0x7f9570071420 msgr2=0x7f957006e840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:36.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.368+0000 7f95756cf700 1 -- 172.21.15.57:0/451762507 shutdown_connections 2023-03-03T07:43:36.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.368+0000 7f95756cf700 1 -- 172.21.15.57:0/451762507 wait complete. 2023-03-03T07:43:36.378 INFO:teuthology.orchestra.run.smithi057.stderr:new fs with metadata pool 3 and data pool 4 2023-03-03T07:43:36.415 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T07:43:36.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.608+0000 7f0bccbb4700 1 Processor -- start 2023-03-03T07:43:36.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.608+0000 7f0bccbb4700 1 -- start start 2023-03-03T07:43:36.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.612+0000 7f0bccbb4700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0bc81289f0 0x7f0bc812add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:36.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.612+0000 7f0bccbb4700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bc808d7f0 con 0x7f0bc8125c80 2023-03-03T07:43:36.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.612+0000 7f0bccbb4700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bc80711a0 con 0x7f0bc81289f0 2023-03-03T07:43:36.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.612+0000 7f0bbeffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0bc81289f0 0x7f0bc812add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:36.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.612+0000 7f0bc77fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f0bc8125c80 0x7f0bc8126050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52458/0 (socket says 172.21.15.57:52458) 2023-03-03T07:43:36.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.612+0000 7f0bc77fe700 1 -- 172.21.15.57:0/4162494995 learned_addr learned my addr 172.21.15.57:0/4162494995 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:43:36.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.612+0000 7f0bbeffd700 1 -- 172.21.15.57:0/4162494995 >> v1:172.21.15.57:6789/0 conn(0x7f0bc8125c80 legacy=0x7f0bc8126050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:36.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.612+0000 7f0bbeffd700 1 -- 172.21.15.57:0/4162494995 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc81256a0 con 0x7f0bc81289f0 2023-03-03T07:43:36.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.612+0000 7f0bc6ffd700 1 -- 172.21.15.57:0/4162494995 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3769687916 0 0) 0x7f0bc808d7f0 con 0x7f0bc8125c80 2023-03-03T07:43:36.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.612+0000 7f0bbeffd700 1 --2- 172.21.15.57:0/4162494995 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bc81289f0 0x7f0bc812add0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0bb00097d0 tx=0x7f0bb0009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1ffe40c65ad14e3 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:36.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.616+0000 7f0bc6ffd700 1 -- 172.21.15.57:0/4162494995 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0bb00041c0 con 0x7f0bc81289f0 2023-03-03T07:43:36.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.616+0000 7f0bc6ffd700 1 -- 172.21.15.57:0/4162494995 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb0004320 con 0x7f0bc81289f0 2023-03-03T07:43:36.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.616+0000 7f0bc6ffd700 1 -- 172.21.15.57:0/4162494995 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0bb00036c0 con 0x7f0bc81289f0 2023-03-03T07:43:36.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.616+0000 7f0bccbb4700 1 -- 172.21.15.57:0/4162494995 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bc81289f0 msgr2=0x7f0bc812add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:36.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.616+0000 7f0bccbb4700 1 --2- 172.21.15.57:0/4162494995 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bc81289f0 0x7f0bc812add0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0bb00097d0 tx=0x7f0bb0009ae0 comp rx=0 tx=0).stop 2023-03-03T07:43:36.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.616+0000 7f0bccbb4700 1 -- 172.21.15.57:0/4162494995 shutdown_connections 2023-03-03T07:43:36.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.616+0000 7f0bccbb4700 1 --2- 172.21.15.57:0/4162494995 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bc81289f0 0x7f0bc812add0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:36.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.616+0000 7f0bccbb4700 1 -- 172.21.15.57:0/4162494995 >> 172.21.15.57:0/4162494995 conn(0x7f0bc806c840 msgr2=0x7f0bc806ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:36.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.616+0000 7f0bccbb4700 1 -- 172.21.15.57:0/4162494995 shutdown_connections 2023-03-03T07:43:36.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.616+0000 7f0bccbb4700 1 -- 172.21.15.57:0/4162494995 wait complete. 2023-03-03T07:43:36.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.620+0000 7f0bccbb4700 1 Processor -- start 2023-03-03T07:43:36.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.620+0000 7f0bccbb4700 1 -- start start 2023-03-03T07:43:36.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.620+0000 7f0bccbb4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bc8125c80 0x7f0bc81bc080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:36.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.620+0000 7f0bccbb4700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc8122fd0 con 0x7f0bc8125c80 2023-03-03T07:43:36.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.620+0000 7f0bc77fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bc8125c80 0x7f0bc81bc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:36.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.620+0000 7f0bc77fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bc8125c80 0x7f0bc81bc080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33922/0 (socket says 172.21.15.57:33922) 2023-03-03T07:43:36.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.620+0000 7f0bc77fe700 1 -- 172.21.15.57:0/1792986260 learned_addr learned my addr 172.21.15.57:0/1792986260 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:36.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.620+0000 7f0bc77fe700 1 -- 172.21.15.57:0/1792986260 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb00094b0 con 0x7f0bc8125c80 2023-03-03T07:43:36.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.620+0000 7f0bc77fe700 1 --2- 172.21.15.57:0/1792986260 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bc8125c80 0x7f0bc81bc080 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0bb800c4d0 tx=0x7f0bb800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:36.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.620+0000 7f0bc4ff9700 1 -- 172.21.15.57:0/1792986260 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0bb8004bd0 con 0x7f0bc8125c80 2023-03-03T07:43:36.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.624+0000 7f0bc4ff9700 1 -- 172.21.15.57:0/1792986260 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb8004d50 con 0x7f0bc8125c80 2023-03-03T07:43:36.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.624+0000 7f0bc4ff9700 1 -- 172.21.15.57:0/1792986260 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0bb80070d0 con 0x7f0bc8125c80 2023-03-03T07:43:36.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.624+0000 7f0bccbb4700 1 -- 172.21.15.57:0/1792986260 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bc812b4a0 con 0x7f0bc8125c80 2023-03-03T07:43:36.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.624+0000 7f0bccbb4700 1 -- 172.21.15.57:0/1792986260 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bc812b310 con 0x7f0bc8125c80 2023-03-03T07:43:36.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.624+0000 7f0bccbb4700 1 -- 172.21.15.57:0/1792986260 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bc812b630 con 0x7f0bc8125c80 2023-03-03T07:43:36.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.624+0000 7f0bc4ff9700 1 -- 172.21.15.57:0/1792986260 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42205+0+0 (secure 0 0 0) 0x7f0bb801a020 con 0x7f0bc8125c80 2023-03-03T07:43:36.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.624+0000 7f0bc4ff9700 1 --2- 172.21.15.57:0/1792986260 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f0ba8034840 0x7f0ba8036cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:36.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.624+0000 7f0bc4ff9700 1 -- 172.21.15.57:0/1792986260 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2928+0+0 (secure 0 0 0) 0x7f0bb8045db0 con 0x7f0bc8125c80 2023-03-03T07:43:36.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.628+0000 7f0bbeffd700 1 --2- 172.21.15.57:0/1792986260 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f0ba8034840 0x7f0ba8036cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:36.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.628+0000 7f0bbeffd700 1 --2- 172.21.15.57:0/1792986260 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f0ba8034840 0x7f0ba8036cf0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0014040 tx=0x7f0bb0010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:36.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.632+0000 7f0bc4ff9700 1 -- 172.21.15.57:0/1792986260 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f0bb801bb70 con 0x7f0bc8125c80 2023-03-03T07:43:36.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.808+0000 7f0bccbb4700 1 -- 172.21.15.57:0/1792986260 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0bc806a790 con 0x7f0bc8125c80 2023-03-03T07:43:36.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.812+0000 7f0bc4ff9700 1 -- 172.21.15.57:0/1792986260 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+9557 (secure 0 0 0) 0x7f0bb801b340 con 0x7f0bc8125c80 2023-03-03T07:43:36.818 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-03T07:43:36.818 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":15,"fsid":"5022d617-ad40-4ad9-8d5b-120958296d9c","created":"2023-03-03T07:43:13.256676+0000","modified":"2023-03-03T07:43:36.354905+0000","last_up_change":"2023-03-03T07:43:22.721740+0000","last_in_change":"2023-03-03T07:43:13.786190+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":1,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-03T07:43:22.864508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":1,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"9","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":1,"score_stable":1,"optimal_score":1,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-03T07:43:28.091327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":1,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1,"score_stable":1,"optimal_score":1,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-03T07:43:33.981804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":1,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1,"score_stable":1,"optimal_score":1,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-03T07:43:35.408700+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":1,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1,"score_stable":1,"optimal_score":1,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d83f7ba7-9d9d-4309-95b9-2b8ad96f2f8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":6,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":28687},{"type":"v1","addr":"172.21.15.57:6801","nonce":28687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":28687},{"type":"v1","addr":"172.21.15.57:6803","nonce":28687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":28687},{"type":"v1","addr":"172.21.15.57:6807","nonce":28687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":28687},{"type":"v1","addr":"172.21.15.57:6805","nonce":28687}]},"public_addr":"172.21.15.57:6801/28687","cluster_addr":"172.21.15.57:6803/28687","heartbeat_back_addr":"172.21.15.57:6807/28687","heartbeat_front_addr":"172.21.15.57:6805/28687","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T07:43:19.859898+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T07:43:36.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.816+0000 7f0bccbb4700 1 -- 172.21.15.57:0/1792986260 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f0ba8034840 msgr2=0x7f0ba8036cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:36.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.816+0000 7f0bccbb4700 1 --2- 172.21.15.57:0/1792986260 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f0ba8034840 0x7f0ba8036cf0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0014040 tx=0x7f0bb0010000 comp rx=0 tx=0).stop 2023-03-03T07:43:36.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.816+0000 7f0bccbb4700 1 -- 172.21.15.57:0/1792986260 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bc8125c80 msgr2=0x7f0bc81bc080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:36.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.816+0000 7f0bccbb4700 1 --2- 172.21.15.57:0/1792986260 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bc8125c80 0x7f0bc81bc080 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0bb800c4d0 tx=0x7f0bb800c890 comp rx=0 tx=0).stop 2023-03-03T07:43:36.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.816+0000 7f0bccbb4700 1 -- 172.21.15.57:0/1792986260 shutdown_connections 2023-03-03T07:43:36.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.816+0000 7f0bccbb4700 1 --2- 172.21.15.57:0/1792986260 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f0ba8034840 0x7f0ba8036cf0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:36.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.816+0000 7f0bccbb4700 1 --2- 172.21.15.57:0/1792986260 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bc8125c80 0x7f0bc81bc080 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:36.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.816+0000 7f0bccbb4700 1 -- 172.21.15.57:0/1792986260 >> 172.21.15.57:0/1792986260 conn(0x7f0bc806c840 msgr2=0x7f0bc8128dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:36.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.816+0000 7f0bccbb4700 1 -- 172.21.15.57:0/1792986260 shutdown_connections 2023-03-03T07:43:36.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:36.816+0000 7f0bccbb4700 1 -- 172.21.15.57:0/1792986260 wait complete. 2023-03-03T07:43:36.856 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T07:43:37.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.060+0000 7feae1484700 1 Processor -- start 2023-03-03T07:43:37.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.060+0000 7feae1484700 1 -- start start 2023-03-03T07:43:37.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.060+0000 7feae1484700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7feadc08aae0 0x7feadc08aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:37.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.060+0000 7feae1484700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feadc08ce40 con 0x7feadc08b3f0 2023-03-03T07:43:37.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.060+0000 7feae1484700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feadc08d150 con 0x7feadc08aae0 2023-03-03T07:43:37.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.060+0000 7feadbfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7feadc08aae0 0x7feadc08aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:37.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.060+0000 7feadbfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7feadc08aae0 0x7feadc08aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33938/0 (socket says 172.21.15.57:33938) 2023-03-03T07:43:37.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.060+0000 7feadbfff700 1 -- 172.21.15.57:0/3921400568 learned_addr learned my addr 172.21.15.57:0/3921400568 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:37.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.060+0000 7feadbfff700 1 -- 172.21.15.57:0/3921400568 >> v1:172.21.15.57:6789/0 conn(0x7feadc08b3f0 legacy=0x7feadc12a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:37.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.060+0000 7feadbfff700 1 -- 172.21.15.57:0/3921400568 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feadc097db0 con 0x7feadc08aae0 2023-03-03T07:43:37.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.064+0000 7feadbfff700 1 --2- 172.21.15.57:0/3921400568 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feadc08aae0 0x7feadc08aeb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7feacc009890 tx=0x7feacc009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4bcad02eb15a483 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:37.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.064+0000 7feadb7fe700 1 -- 172.21.15.57:0/3921400568 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feacc004160 con 0x7feadc08aae0 2023-03-03T07:43:37.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.064+0000 7feadb7fe700 1 -- 172.21.15.57:0/3921400568 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feacc0042c0 con 0x7feadc08aae0 2023-03-03T07:43:37.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.064+0000 7feadb7fe700 1 -- 172.21.15.57:0/3921400568 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feacc004580 con 0x7feadc08aae0 2023-03-03T07:43:37.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.064+0000 7feae1484700 1 -- 172.21.15.57:0/3921400568 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feadc08aae0 msgr2=0x7feadc08aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:37.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.064+0000 7feae1484700 1 --2- 172.21.15.57:0/3921400568 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feadc08aae0 0x7feadc08aeb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7feacc009890 tx=0x7feacc009ba0 comp rx=0 tx=0).stop 2023-03-03T07:43:37.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.064+0000 7feae1484700 1 -- 172.21.15.57:0/3921400568 shutdown_connections 2023-03-03T07:43:37.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.064+0000 7feae1484700 1 --2- 172.21.15.57:0/3921400568 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feadc08aae0 0x7feadc08aeb0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:37.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.064+0000 7feae1484700 1 -- 172.21.15.57:0/3921400568 >> 172.21.15.57:0/3921400568 conn(0x7feadc06d690 msgr2=0x7feadc06faa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:37.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.064+0000 7feae1484700 1 -- 172.21.15.57:0/3921400568 shutdown_connections 2023-03-03T07:43:37.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.064+0000 7feae1484700 1 -- 172.21.15.57:0/3921400568 wait complete. 2023-03-03T07:43:37.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.068+0000 7feae1484700 1 Processor -- start 2023-03-03T07:43:37.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.068+0000 7feae1484700 1 -- start start 2023-03-03T07:43:37.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.068+0000 7feae1484700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feadc08aae0 0x7feadc121230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:37.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.068+0000 7feae1484700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feadc120ce0 con 0x7feadc08aae0 2023-03-03T07:43:37.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.068+0000 7feadbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feadc08aae0 0x7feadc121230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:37.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.068+0000 7feadbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feadc08aae0 0x7feadc121230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33942/0 (socket says 172.21.15.57:33942) 2023-03-03T07:43:37.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.068+0000 7feadbfff700 1 -- 172.21.15.57:0/655726562 learned_addr learned my addr 172.21.15.57:0/655726562 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:37.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.068+0000 7feadbfff700 1 -- 172.21.15.57:0/655726562 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feacc009570 con 0x7feadc08aae0 2023-03-03T07:43:37.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.072+0000 7feadbfff700 1 --2- 172.21.15.57:0/655726562 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feadc08aae0 0x7feadc121230 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7feacc009be0 tx=0x7feacc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:37.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.072+0000 7fead97fa700 1 -- 172.21.15.57:0/655726562 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feacc00b670 con 0x7feadc08aae0 2023-03-03T07:43:37.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.072+0000 7fead97fa700 1 -- 172.21.15.57:0/655726562 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feacc00b7d0 con 0x7feadc08aae0 2023-03-03T07:43:37.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.072+0000 7feae1484700 1 -- 172.21.15.57:0/655726562 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feadc12b7f0 con 0x7feadc08aae0 2023-03-03T07:43:37.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.072+0000 7fead97fa700 1 -- 172.21.15.57:0/655726562 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feacc00b940 con 0x7feadc08aae0 2023-03-03T07:43:37.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.072+0000 7feae1484700 1 -- 172.21.15.57:0/655726562 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feadc08b840 con 0x7feadc08aae0 2023-03-03T07:43:37.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.072+0000 7feae1484700 1 -- 172.21.15.57:0/655726562 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feadc12b980 con 0x7feadc08aae0 2023-03-03T07:43:37.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.072+0000 7fead97fa700 1 -- 172.21.15.57:0/655726562 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42205+0+0 (secure 0 0 0) 0x7feacc017020 con 0x7feadc08aae0 2023-03-03T07:43:37.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.076+0000 7fead97fa700 1 --2- 172.21.15.57:0/655726562 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7feabc034840 0x7feabc036cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:37.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.076+0000 7fead97fa700 1 -- 172.21.15.57:0/655726562 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2928+0+0 (secure 0 0 0) 0x7feacc0479c0 con 0x7feadc08aae0 2023-03-03T07:43:37.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.076+0000 7fead3fff700 1 --2- 172.21.15.57:0/655726562 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7feabc034840 0x7feabc036cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:37.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.076+0000 7fead3fff700 1 --2- 172.21.15.57:0/655726562 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7feabc034840 0x7feabc036cf0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7feac4001620 tx=0x7feac4007b00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:37.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.080+0000 7fead97fa700 1 -- 172.21.15.57:0/655726562 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7feacc02cdc0 con 0x7feadc08aae0 2023-03-03T07:43:37.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.256+0000 7feae1484700 1 -- 172.21.15.57:0/655726562 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feadc120e20 con 0x7feadc08aae0 2023-03-03T07:43:37.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.260+0000 7fead97fa700 1 -- 172.21.15.57:0/655726562 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+9557 (secure 0 0 0) 0x7feadc120e20 con 0x7feadc08aae0 2023-03-03T07:43:37.265 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-03T07:43:37.265 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":15,"fsid":"5022d617-ad40-4ad9-8d5b-120958296d9c","created":"2023-03-03T07:43:13.256676+0000","modified":"2023-03-03T07:43:36.354905+0000","last_up_change":"2023-03-03T07:43:22.721740+0000","last_in_change":"2023-03-03T07:43:13.786190+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":1,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-03T07:43:22.864508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":1,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"9","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":1,"score_stable":1,"optimal_score":1,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-03T07:43:28.091327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":1,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1,"score_stable":1,"optimal_score":1,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-03T07:43:33.981804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":1,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1,"score_stable":1,"optimal_score":1,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-03T07:43:35.408700+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":1,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1,"score_stable":1,"optimal_score":1,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d83f7ba7-9d9d-4309-95b9-2b8ad96f2f8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":6,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":28687},{"type":"v1","addr":"172.21.15.57:6801","nonce":28687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":28687},{"type":"v1","addr":"172.21.15.57:6803","nonce":28687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":28687},{"type":"v1","addr":"172.21.15.57:6807","nonce":28687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":28687},{"type":"v1","addr":"172.21.15.57:6805","nonce":28687}]},"public_addr":"172.21.15.57:6801/28687","cluster_addr":"172.21.15.57:6803/28687","heartbeat_back_addr":"172.21.15.57:6807/28687","heartbeat_front_addr":"172.21.15.57:6805/28687","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T07:43:19.859898+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T07:43:37.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.264+0000 7feae1484700 1 -- 172.21.15.57:0/655726562 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7feabc034840 msgr2=0x7feabc036cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:37.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.264+0000 7feae1484700 1 --2- 172.21.15.57:0/655726562 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7feabc034840 0x7feabc036cf0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7feac4001620 tx=0x7feac4007b00 comp rx=0 tx=0).stop 2023-03-03T07:43:37.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.264+0000 7feae1484700 1 -- 172.21.15.57:0/655726562 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feadc08aae0 msgr2=0x7feadc121230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:37.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.264+0000 7feae1484700 1 --2- 172.21.15.57:0/655726562 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feadc08aae0 0x7feadc121230 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7feacc009be0 tx=0x7feacc004770 comp rx=0 tx=0).stop 2023-03-03T07:43:37.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.264+0000 7feae1484700 1 -- 172.21.15.57:0/655726562 shutdown_connections 2023-03-03T07:43:37.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.264+0000 7feae1484700 1 --2- 172.21.15.57:0/655726562 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7feabc034840 0x7feabc036cf0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:37.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.264+0000 7feae1484700 1 --2- 172.21.15.57:0/655726562 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feadc08aae0 0x7feadc121230 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:37.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.264+0000 7feae1484700 1 -- 172.21.15.57:0/655726562 >> 172.21.15.57:0/655726562 conn(0x7feadc06d690 msgr2=0x7feadc06fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:37.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.264+0000 7feae1484700 1 -- 172.21.15.57:0/655726562 shutdown_connections 2023-03-03T07:43:37.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.264+0000 7feae1484700 1 -- 172.21.15.57:0/655726562 wait complete. 2023-03-03T07:43:37.303 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-03-03T07:43:37.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.524+0000 7f259ca45700 1 Processor -- start 2023-03-03T07:43:37.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.524+0000 7f259ca45700 1 -- start start 2023-03-03T07:43:37.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.524+0000 7f259ca45700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2598095f30 0x7f2598096300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:37.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.528+0000 7f259ca45700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f259808b510 con 0x7f259808a370 2023-03-03T07:43:37.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.528+0000 7f259ca45700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f259808e410 con 0x7f2598095f30 2023-03-03T07:43:37.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.528+0000 7f2596ffd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f259808a370 0x7f259808a7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52482/0 (socket says 172.21.15.57:52482) 2023-03-03T07:43:37.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.528+0000 7f2596ffd700 1 -- 172.21.15.57:0/3775161829 learned_addr learned my addr 172.21.15.57:0/3775161829 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:43:37.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.528+0000 7f25977fe700 1 --2- 172.21.15.57:0/3775161829 >> v2:172.21.15.57:3300/0 conn(0x7f2598095f30 0x7f2598096300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:37.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.528+0000 7f25967fc700 1 -- 172.21.15.57:0/3775161829 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 412949699 0 0) 0x7f259808b510 con 0x7f259808a370 2023-03-03T07:43:37.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.528+0000 7f25967fc700 1 -- 172.21.15.57:0/3775161829 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25800035d0 con 0x7f259808a370 2023-03-03T07:43:37.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.528+0000 7f25977fe700 1 -- 172.21.15.57:0/3775161829 >> v1:172.21.15.57:6789/0 conn(0x7f259808a370 legacy=0x7f259808a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:37.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.528+0000 7f25977fe700 1 -- 172.21.15.57:0/3775161829 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f259808e600 con 0x7f2598095f30 2023-03-03T07:43:37.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.528+0000 7f25977fe700 1 --2- 172.21.15.57:0/3775161829 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2598095f30 0x7f2598096300 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f25880097c0 tx=0x7f2588009ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b76f3d8472a55f26 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:37.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.528+0000 7f25967fc700 1 -- 172.21.15.57:0/3775161829 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2588005d80 con 0x7f2598095f30 2023-03-03T07:43:37.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.528+0000 7f25967fc700 1 -- 172.21.15.57:0/3775161829 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2588004030 con 0x7f2598095f30 2023-03-03T07:43:37.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.528+0000 7f25967fc700 1 -- 172.21.15.57:0/3775161829 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25880042f0 con 0x7f2598095f30 2023-03-03T07:43:37.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.532+0000 7f259ca45700 1 -- 172.21.15.57:0/3775161829 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2598095f30 msgr2=0x7f2598096300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:37.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.532+0000 7f259ca45700 1 --2- 172.21.15.57:0/3775161829 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2598095f30 0x7f2598096300 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f25880097c0 tx=0x7f2588009ad0 comp rx=0 tx=0).stop 2023-03-03T07:43:37.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.532+0000 7f259ca45700 1 -- 172.21.15.57:0/3775161829 shutdown_connections 2023-03-03T07:43:37.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.532+0000 7f259ca45700 1 --2- 172.21.15.57:0/3775161829 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2598095f30 0x7f2598096300 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:37.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.532+0000 7f259ca45700 1 -- 172.21.15.57:0/3775161829 >> 172.21.15.57:0/3775161829 conn(0x7f259806da50 msgr2=0x7f259806fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:37.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.532+0000 7f259ca45700 1 -- 172.21.15.57:0/3775161829 shutdown_connections 2023-03-03T07:43:37.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.532+0000 7f259ca45700 1 -- 172.21.15.57:0/3775161829 wait complete. 2023-03-03T07:43:37.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.532+0000 7f259ca45700 1 Processor -- start 2023-03-03T07:43:37.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.532+0000 7f259ca45700 1 -- start start 2023-03-03T07:43:37.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.532+0000 7f259ca45700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f259808a370 0x7f25980921b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:37.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.532+0000 7f259ca45700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25981238b0 con 0x7f259808a370 2023-03-03T07:43:37.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.536+0000 7f25977fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f259808a370 0x7f25980921b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:37.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.536+0000 7f25977fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f259808a370 0x7f25980921b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33962/0 (socket says 172.21.15.57:33962) 2023-03-03T07:43:37.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.536+0000 7f25977fe700 1 -- 172.21.15.57:0/107912733 learned_addr learned my addr 172.21.15.57:0/107912733 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:37.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.536+0000 7f25977fe700 1 -- 172.21.15.57:0/107912733 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2588009450 con 0x7f259808a370 2023-03-03T07:43:37.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.536+0000 7f25977fe700 1 --2- 172.21.15.57:0/107912733 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f259808a370 0x7f25980921b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2588000c00 tx=0x7f2588004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:37.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.536+0000 7f257ffff700 1 -- 172.21.15.57:0/107912733 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f258801d430 con 0x7f259808a370 2023-03-03T07:43:37.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.536+0000 7f257ffff700 1 -- 172.21.15.57:0/107912733 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f258801d590 con 0x7f259808a370 2023-03-03T07:43:37.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.536+0000 7f257ffff700 1 -- 172.21.15.57:0/107912733 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f258801d850 con 0x7f259808a370 2023-03-03T07:43:37.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.536+0000 7f259ca45700 1 -- 172.21.15.57:0/107912733 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25980969d0 con 0x7f259808a370 2023-03-03T07:43:37.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.536+0000 7f259ca45700 1 -- 172.21.15.57:0/107912733 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2598096840 con 0x7f259808a370 2023-03-03T07:43:37.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.540+0000 7f257ffff700 1 -- 172.21.15.57:0/107912733 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42205+0+0 (secure 0 0 0) 0x7f258802d070 con 0x7f259808a370 2023-03-03T07:43:37.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.540+0000 7f259ca45700 1 -- 172.21.15.57:0/107912733 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f259808aee0 con 0x7f259808a370 2023-03-03T07:43:37.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.540+0000 7f257ffff700 1 --2- 172.21.15.57:0/107912733 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f2584034840 0x7f2584036cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:37.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.540+0000 7f257ffff700 1 -- 172.21.15.57:0/107912733 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2928+0+0 (secure 0 0 0) 0x7f2588006e40 con 0x7f259808a370 2023-03-03T07:43:37.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.540+0000 7f2596ffd700 1 --2- 172.21.15.57:0/107912733 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f2584034840 0x7f2584036cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:37.547 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.540+0000 7f2596ffd700 1 --2- 172.21.15.57:0/107912733 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f2584034840 0x7f2584036cf0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f258c0016d0 tx=0x7f258c007a20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:37.551 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.544+0000 7f257ffff700 1 -- 172.21.15.57:0/107912733 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f258801da40 con 0x7f259808a370 2023-03-03T07:43:37.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:37.756+0000 7f259ca45700 1 -- 172.21.15.57:0/107912733 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f25980619b0 con 0x7f259808a370 2023-03-03T07:43:38.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:38.368+0000 7f257ffff700 1 -- 172.21.15.57:0/107912733 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2588016020 con 0x7f259808a370 2023-03-03T07:43:38.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:38.376+0000 7f259ca45700 1 -- 172.21.15.57:0/107912733 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f2584034840 msgr2=0x7f2584036cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:38.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:38.376+0000 7f259ca45700 1 --2- 172.21.15.57:0/107912733 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f2584034840 0x7f2584036cf0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f258c0016d0 tx=0x7f258c007a20 comp rx=0 tx=0).stop 2023-03-03T07:43:38.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:38.376+0000 7f259ca45700 1 -- 172.21.15.57:0/107912733 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f259808a370 msgr2=0x7f25980921b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:38.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:38.376+0000 7f259ca45700 1 --2- 172.21.15.57:0/107912733 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f259808a370 0x7f25980921b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2588000c00 tx=0x7f2588004770 comp rx=0 tx=0).stop 2023-03-03T07:43:38.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:38.376+0000 7f259ca45700 1 -- 172.21.15.57:0/107912733 shutdown_connections 2023-03-03T07:43:38.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:38.376+0000 7f259ca45700 1 --2- 172.21.15.57:0/107912733 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f2584034840 0x7f2584036cf0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:38.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:38.376+0000 7f259ca45700 1 --2- 172.21.15.57:0/107912733 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f259808a370 0x7f25980921b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:38.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:38.376+0000 7f259ca45700 1 -- 172.21.15.57:0/107912733 >> 172.21.15.57:0/107912733 conn(0x7f259806da50 msgr2=0x7f259806f170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:38.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:38.376+0000 7f259ca45700 1 -- 172.21.15.57:0/107912733 shutdown_connections 2023-03-03T07:43:38.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:38.376+0000 7f259ca45700 1 -- 172.21.15.57:0/107912733 wait complete. 2023-03-03T07:43:38.415 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-03-03T07:43:38.415 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-03-03T07:43:38.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:38.620+0000 7f26aa5e8700 1 Processor -- start 2023-03-03T07:43:38.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:38.620+0000 7f26aa5e8700 1 -- start start 2023-03-03T07:43:38.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:38.624+0000 7f26aa5e8700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f26a408bf80 0x7f26a408c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:38.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:38.624+0000 7f26aa5e8700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26a408d2b0 con 0x7f26a408c890 2023-03-03T07:43:38.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:38.624+0000 7f26aa5e8700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26a408d550 con 0x7f26a408bf80 2023-03-03T07:43:38.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:38.624+0000 7f26a95e6700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f26a408bf80 0x7f26a408c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:38.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:38.624+0000 7f26a8de5700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f26a408c890 0x7f26a4095b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52484/0 (socket says 172.21.15.57:52484) 2023-03-03T07:43:38.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:38.624+0000 7f26a8de5700 1 -- 172.21.15.57:0/1460571918 learned_addr learned my addr 172.21.15.57:0/1460571918 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:43:38.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:38.624+0000 7f269bfff700 1 -- 172.21.15.57:0/1460571918 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 393772643 0 0) 0x7f26a408d2b0 con 0x7f26a408c890 2023-03-03T07:43:38.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:38.624+0000 7f26a95e6700 1 -- 172.21.15.57:0/1460571918 >> v1:172.21.15.57:6789/0 conn(0x7f26a408c890 legacy=0x7f26a4095b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:38.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:38.624+0000 7f26a95e6700 1 -- 172.21.15.57:0/1460571918 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a408a500 con 0x7f26a408bf80 2023-03-03T07:43:38.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:38.624+0000 7f26a95e6700 1 --2- 172.21.15.57:0/1460571918 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26a408bf80 0x7f26a408c350 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f26a00097c0 tx=0x7f26a0009ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ec23e828a23de8b server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:38.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:38.624+0000 7f269bfff700 1 -- 172.21.15.57:0/1460571918 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f26a0004160 con 0x7f26a408bf80 2023-03-03T07:43:38.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:38.624+0000 7f269bfff700 1 -- 172.21.15.57:0/1460571918 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26a00042c0 con 0x7f26a408bf80 2023-03-03T07:43:38.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:38.624+0000 7f269bfff700 1 -- 172.21.15.57:0/1460571918 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f26a0004580 con 0x7f26a408bf80 2023-03-03T07:43:38.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:38.624+0000 7f26aa5e8700 1 -- 172.21.15.57:0/1460571918 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26a408bf80 msgr2=0x7f26a408c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:38.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:38.624+0000 7f26aa5e8700 1 --2- 172.21.15.57:0/1460571918 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26a408bf80 0x7f26a408c350 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f26a00097c0 tx=0x7f26a0009ad0 comp rx=0 tx=0).stop 2023-03-03T07:43:38.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:38.628+0000 7f26aa5e8700 1 -- 172.21.15.57:0/1460571918 shutdown_connections 2023-03-03T07:43:38.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:38.628+0000 7f26aa5e8700 1 --2- 172.21.15.57:0/1460571918 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26a408bf80 0x7f26a408c350 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:38.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:38.628+0000 7f26aa5e8700 1 -- 172.21.15.57:0/1460571918 >> 172.21.15.57:0/1460571918 conn(0x7f26a406da50 msgr2=0x7f26a406fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:38.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:38.628+0000 7f26aa5e8700 1 -- 172.21.15.57:0/1460571918 shutdown_connections 2023-03-03T07:43:38.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:38.628+0000 7f26aa5e8700 1 -- 172.21.15.57:0/1460571918 wait complete. 2023-03-03T07:43:38.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:38.632+0000 7f26aa5e8700 1 Processor -- start 2023-03-03T07:43:38.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:38.632+0000 7f26aa5e8700 1 -- start start 2023-03-03T07:43:38.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:38.632+0000 7f26aa5e8700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26a408bf80 0x7f26a4094a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:38.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:38.632+0000 7f26aa5e8700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a408eb50 con 0x7f26a408bf80 2023-03-03T07:43:38.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:38.632+0000 7f26a95e6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26a408bf80 0x7f26a4094a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:38.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:38.632+0000 7f26a95e6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26a408bf80 0x7f26a4094a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33976/0 (socket says 172.21.15.57:33976) 2023-03-03T07:43:38.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:38.632+0000 7f26a95e6700 1 -- 172.21.15.57:0/3006843033 learned_addr learned my addr 172.21.15.57:0/3006843033 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:38.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:38.632+0000 7f26a95e6700 1 -- 172.21.15.57:0/3006843033 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a0009450 con 0x7f26a408bf80 2023-03-03T07:43:38.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:38.632+0000 7f26a95e6700 1 --2- 172.21.15.57:0/3006843033 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26a408bf80 0x7f26a4094a60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f26a00090b0 tx=0x7f26a0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:38.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:38.636+0000 7f2699ffb700 1 -- 172.21.15.57:0/3006843033 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f26a0003dd0 con 0x7f26a408bf80 2023-03-03T07:43:38.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:38.636+0000 7f2699ffb700 1 -- 172.21.15.57:0/3006843033 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26a001f070 con 0x7f26a408bf80 2023-03-03T07:43:38.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:38.636+0000 7f2699ffb700 1 -- 172.21.15.57:0/3006843033 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f26a0011780 con 0x7f26a408bf80 2023-03-03T07:43:38.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:38.636+0000 7f26aa5e8700 1 -- 172.21.15.57:0/3006843033 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26a40963a0 con 0x7f26a408bf80 2023-03-03T07:43:38.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:38.636+0000 7f26aa5e8700 1 -- 172.21.15.57:0/3006843033 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26a4096210 con 0x7f26a408bf80 2023-03-03T07:43:38.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:38.640+0000 7f2699ffb700 1 -- 172.21.15.57:0/3006843033 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42205+0+0 (secure 0 0 0) 0x7f26a002a020 con 0x7f26a408bf80 2023-03-03T07:43:38.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:38.640+0000 7f26aa5e8700 1 -- 172.21.15.57:0/3006843033 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26a4096530 con 0x7f26a408bf80 2023-03-03T07:43:38.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:38.640+0000 7f2699ffb700 1 --2- 172.21.15.57:0/3006843033 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f2688038c50 0x7f268803b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:38.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:38.640+0000 7f2699ffb700 1 -- 172.21.15.57:0/3006843033 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2928+0+0 (secure 0 0 0) 0x7f26a00479d0 con 0x7f26a408bf80 2023-03-03T07:43:38.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:38.640+0000 7f26a8de5700 1 --2- 172.21.15.57:0/3006843033 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f2688038c50 0x7f268803b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:38.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:38.644+0000 7f26a8de5700 1 --2- 172.21.15.57:0/3006843033 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f2688038c50 0x7f268803b100 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2694005930 tx=0x7f2694007a20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:38.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:38.648+0000 7f2699ffb700 1 -- 172.21.15.57:0/3006843033 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f26a00119b0 con 0x7f26a408bf80 2023-03-03T07:43:38.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:38.860+0000 7f26aa5e8700 1 -- 172.21.15.57:0/3006843033 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f26a408ec90 con 0x7f26a408bf80 2023-03-03T07:43:39.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.376+0000 7f2699ffb700 1 -- 172.21.15.57:0/3006843033 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f26a408ec90 con 0x7f26a408bf80 2023-03-03T07:43:39.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.380+0000 7f26aa5e8700 1 -- 172.21.15.57:0/3006843033 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f2688038c50 msgr2=0x7f268803b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:39.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.380+0000 7f26aa5e8700 1 --2- 172.21.15.57:0/3006843033 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f2688038c50 0x7f268803b100 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2694005930 tx=0x7f2694007a20 comp rx=0 tx=0).stop 2023-03-03T07:43:39.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.380+0000 7f26aa5e8700 1 -- 172.21.15.57:0/3006843033 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26a408bf80 msgr2=0x7f26a4094a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:39.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.380+0000 7f26aa5e8700 1 --2- 172.21.15.57:0/3006843033 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26a408bf80 0x7f26a4094a60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f26a00090b0 tx=0x7f26a0004770 comp rx=0 tx=0).stop 2023-03-03T07:43:39.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.380+0000 7f26aa5e8700 1 -- 172.21.15.57:0/3006843033 shutdown_connections 2023-03-03T07:43:39.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.380+0000 7f26aa5e8700 1 --2- 172.21.15.57:0/3006843033 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f2688038c50 0x7f268803b100 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:39.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.380+0000 7f26aa5e8700 1 --2- 172.21.15.57:0/3006843033 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26a408bf80 0x7f26a4094a60 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:39.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.380+0000 7f26aa5e8700 1 -- 172.21.15.57:0/3006843033 >> 172.21.15.57:0/3006843033 conn(0x7f26a406da50 msgr2=0x7f26a406ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:39.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.380+0000 7f26aa5e8700 1 -- 172.21.15.57:0/3006843033 shutdown_connections 2023-03-03T07:43:39.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.380+0000 7f26aa5e8700 1 -- 172.21.15.57:0/3006843033 wait complete. 2023-03-03T07:43:39.420 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-03-03T07:43:39.420 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-03T07:43:39.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.612+0000 7fd9ab59e700 1 Processor -- start 2023-03-03T07:43:39.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.612+0000 7fd9ab59e700 1 -- start start 2023-03-03T07:43:39.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.612+0000 7fd9ab59e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd9ac089f80 0x7fd9ac08a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:39.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.612+0000 7fd9ab59e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9ac095b20 con 0x7fd9ac08a890 2023-03-03T07:43:39.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.612+0000 7fd9ab59e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9ac08b1e0 con 0x7fd9ac089f80 2023-03-03T07:43:39.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.616+0000 7fd9aa59c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd9ac089f80 0x7fd9ac08a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:39.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.616+0000 7fd9a1d9b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fd9ac08a890 0x7fd9ac12c1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56764/0 (socket says 172.21.15.57:56764) 2023-03-03T07:43:39.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.616+0000 7fd9a1d9b700 1 -- 172.21.15.57:0/3496086397 learned_addr learned my addr 172.21.15.57:0/3496086397 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:43:39.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.616+0000 7fd9aa59c700 1 -- 172.21.15.57:0/3496086397 >> v1:172.21.15.57:6789/0 conn(0x7fd9ac08a890 legacy=0x7fd9ac12c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:39.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.616+0000 7fd9aa59c700 1 -- 172.21.15.57:0/3496086397 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9ac08b4f0 con 0x7fd9ac089f80 2023-03-03T07:43:39.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.616+0000 7fd9a9d9b700 1 -- 172.21.15.57:0/3496086397 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3253512045 0 0) 0x7fd9ac095b20 con 0x7fd9ac08a890 2023-03-03T07:43:39.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.616+0000 7fd9aa59c700 1 --2- 172.21.15.57:0/3496086397 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9ac089f80 0x7fd9ac08a350 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd99c0097d0 tx=0x7fd99c009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4bf416b1dc6771d server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:39.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.616+0000 7fd9a9d9b700 1 -- 172.21.15.57:0/3496086397 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd99c0041c0 con 0x7fd9ac089f80 2023-03-03T07:43:39.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.616+0000 7fd9a9d9b700 1 -- 172.21.15.57:0/3496086397 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd99c004320 con 0x7fd9ac089f80 2023-03-03T07:43:39.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.616+0000 7fd9a9d9b700 1 -- 172.21.15.57:0/3496086397 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd99c0036c0 con 0x7fd9ac089f80 2023-03-03T07:43:39.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.616+0000 7fd9ab59e700 1 -- 172.21.15.57:0/3496086397 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9ac089f80 msgr2=0x7fd9ac08a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:39.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.616+0000 7fd9ab59e700 1 --2- 172.21.15.57:0/3496086397 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9ac089f80 0x7fd9ac08a350 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd99c0097d0 tx=0x7fd99c009ae0 comp rx=0 tx=0).stop 2023-03-03T07:43:39.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.616+0000 7fd9ab59e700 1 -- 172.21.15.57:0/3496086397 shutdown_connections 2023-03-03T07:43:39.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.616+0000 7fd9ab59e700 1 --2- 172.21.15.57:0/3496086397 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9ac089f80 0x7fd9ac08a350 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:39.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.616+0000 7fd9ab59e700 1 -- 172.21.15.57:0/3496086397 >> 172.21.15.57:0/3496086397 conn(0x7fd9ac06c840 msgr2=0x7fd9ac06ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:39.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.616+0000 7fd9ab59e700 1 -- 172.21.15.57:0/3496086397 shutdown_connections 2023-03-03T07:43:39.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.616+0000 7fd9ab59e700 1 -- 172.21.15.57:0/3496086397 wait complete. 2023-03-03T07:43:39.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.620+0000 7fd9ab59e700 1 Processor -- start 2023-03-03T07:43:39.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.620+0000 7fd9ab59e700 1 -- start start 2023-03-03T07:43:39.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.620+0000 7fd9ab59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9ac089f80 0x7fd9ac1bbea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:39.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.620+0000 7fd9ab59e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ac11f810 con 0x7fd9ac089f80 2023-03-03T07:43:39.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.624+0000 7fd9aa59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9ac089f80 0x7fd9ac1bbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:39.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.624+0000 7fd9aa59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9ac089f80 0x7fd9ac1bbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35576/0 (socket says 172.21.15.57:35576) 2023-03-03T07:43:39.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.624+0000 7fd9aa59c700 1 -- 172.21.15.57:0/3157312643 learned_addr learned my addr 172.21.15.57:0/3157312643 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:39.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.624+0000 7fd9aa59c700 1 -- 172.21.15.57:0/3157312643 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd99c0094b0 con 0x7fd9ac089f80 2023-03-03T07:43:39.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.624+0000 7fd9aa59c700 1 --2- 172.21.15.57:0/3157312643 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9ac089f80 0x7fd9ac1bbea0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd99c009b20 tx=0x7fd99c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:39.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.624+0000 7fd9a37fe700 1 -- 172.21.15.57:0/3157312643 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd99c006ea0 con 0x7fd9ac089f80 2023-03-03T07:43:39.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.624+0000 7fd9a37fe700 1 -- 172.21.15.57:0/3157312643 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd99c011760 con 0x7fd9ac089f80 2023-03-03T07:43:39.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.624+0000 7fd9a37fe700 1 -- 172.21.15.57:0/3157312643 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd99c011a00 con 0x7fd9ac089f80 2023-03-03T07:43:39.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.624+0000 7fd9ab59e700 1 -- 172.21.15.57:0/3157312643 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9ac12d910 con 0x7fd9ac089f80 2023-03-03T07:43:39.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.624+0000 7fd9ab59e700 1 -- 172.21.15.57:0/3157312643 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9ac08ad30 con 0x7fd9ac089f80 2023-03-03T07:43:39.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.628+0000 7fd9ab59e700 1 -- 172.21.15.57:0/3157312643 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9ac12daa0 con 0x7fd9ac089f80 2023-03-03T07:43:39.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.628+0000 7fd9a37fe700 1 -- 172.21.15.57:0/3157312643 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42205+0+0 (secure 0 0 0) 0x7fd99c02d070 con 0x7fd9ac089f80 2023-03-03T07:43:39.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.628+0000 7fd9a37fe700 1 --2- 172.21.15.57:0/3157312643 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fd98c034840 0x7fd98c036cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:39.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.628+0000 7fd9a37fe700 1 -- 172.21.15.57:0/3157312643 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2928+0+0 (secure 0 0 0) 0x7fd99c0470f0 con 0x7fd9ac089f80 2023-03-03T07:43:39.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.628+0000 7fd9a1d9b700 1 --2- 172.21.15.57:0/3157312643 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fd98c034840 0x7fd98c036cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:39.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.632+0000 7fd9a1d9b700 1 --2- 172.21.15.57:0/3157312643 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fd98c034840 0x7fd98c036cf0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd994000c00 tx=0x7fd9940079c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:39.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.636+0000 7fd9a37fe700 1 -- 172.21.15.57:0/3157312643 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd99c0259a0 con 0x7fd9ac089f80 2023-03-03T07:43:39.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.844+0000 7fd9ab59e700 1 -- 172.21.15.57:0/3157312643 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd9ac0619b0 con 0x7fd9ac089f80 2023-03-03T07:43:39.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.844+0000 7fd9a37fe700 1 -- 172.21.15.57:0/3157312643 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2375 (secure 0 0 0) 0x7fd99c016020 con 0x7fd9ac089f80 2023-03-03T07:43:39.851 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-03T07:43:39.851 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-03T07:43:36.355228+0000","modified":"2023-03-03T07:43:39.370352+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4134},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4134":{"gid":4134,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6811/2058274046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2058274046},{"type":"v1","addr":"172.21.15.57:6811","nonce":2058274046}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-03-03T07:43:39.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.848+0000 7fd9ab59e700 1 -- 172.21.15.57:0/3157312643 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fd98c034840 msgr2=0x7fd98c036cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:39.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.848+0000 7fd9ab59e700 1 --2- 172.21.15.57:0/3157312643 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fd98c034840 0x7fd98c036cf0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd994000c00 tx=0x7fd9940079c0 comp rx=0 tx=0).stop 2023-03-03T07:43:39.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.848+0000 7fd9ab59e700 1 -- 172.21.15.57:0/3157312643 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9ac089f80 msgr2=0x7fd9ac1bbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:39.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.848+0000 7fd9ab59e700 1 --2- 172.21.15.57:0/3157312643 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9ac089f80 0x7fd9ac1bbea0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd99c009b20 tx=0x7fd99c004770 comp rx=0 tx=0).stop 2023-03-03T07:43:39.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.848+0000 7fd9ab59e700 1 -- 172.21.15.57:0/3157312643 shutdown_connections 2023-03-03T07:43:39.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.848+0000 7fd9ab59e700 1 --2- 172.21.15.57:0/3157312643 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fd98c034840 0x7fd98c036cf0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:39.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.848+0000 7fd9ab59e700 1 --2- 172.21.15.57:0/3157312643 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9ac089f80 0x7fd9ac1bbea0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:39.855 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.848+0000 7fd9ab59e700 1 -- 172.21.15.57:0/3157312643 >> 172.21.15.57:0/3157312643 conn(0x7fd9ac06c840 msgr2=0x7fd9ac06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:39.855 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.848+0000 7fd9ab59e700 1 -- 172.21.15.57:0/3157312643 shutdown_connections 2023-03-03T07:43:39.855 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:39.848+0000 7fd9ab59e700 1 -- 172.21.15.57:0/3157312643 wait complete. 2023-03-03T07:43:39.858 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 6 2023-03-03T07:43:39.886 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T07:43:40.030 INFO:tasks.ceph.mds.a.smithi057.stderr:2023-03-03T07:43:40.024+0000 7f1afc7de700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-03-03T07:43:40.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.088+0000 7fb011e66700 1 Processor -- start 2023-03-03T07:43:40.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.088+0000 7fb011e66700 1 -- start start 2023-03-03T07:43:40.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.088+0000 7fb011e66700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb00c0992b0 0x7fb00c099680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:40.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.088+0000 7fb011e66700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb00c08f6a0 con 0x7fb00c08e390 2023-03-03T07:43:40.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.088+0000 7fb011e66700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb00c072220 con 0x7fb00c0992b0 2023-03-03T07:43:40.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.088+0000 7fb010e64700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb00c0992b0 0x7fb00c099680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:40.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.088+0000 7fb00bfff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fb00c08e390 0x7fb00c08e7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56780/0 (socket says 172.21.15.57:56780) 2023-03-03T07:43:40.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.088+0000 7fb00bfff700 1 -- 172.21.15.57:0/1384787940 learned_addr learned my addr 172.21.15.57:0/1384787940 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:43:40.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.092+0000 7fb010e64700 1 -- 172.21.15.57:0/1384787940 >> v1:172.21.15.57:6789/0 conn(0x7fb00c08e390 legacy=0x7fb00c08e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:40.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.092+0000 7fb010e64700 1 -- 172.21.15.57:0/1384787940 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb00c08f970 con 0x7fb00c0992b0 2023-03-03T07:43:40.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.092+0000 7fb00b7fe700 1 -- 172.21.15.57:0/1384787940 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3575394125 0 0) 0x7fb00c08f6a0 con 0x7fb00c08e390 2023-03-03T07:43:40.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.092+0000 7fb010e64700 1 --2- 172.21.15.57:0/1384787940 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb00c0992b0 0x7fb00c099680 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb0000097d0 tx=0x7fb000009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d8c3200c81e5dd8 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:40.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.092+0000 7fb00b7fe700 1 -- 172.21.15.57:0/1384787940 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb0000041c0 con 0x7fb00c0992b0 2023-03-03T07:43:40.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.092+0000 7fb00b7fe700 1 -- 172.21.15.57:0/1384787940 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb000004320 con 0x7fb00c0992b0 2023-03-03T07:43:40.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.092+0000 7fb00b7fe700 1 -- 172.21.15.57:0/1384787940 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb0000036c0 con 0x7fb00c0992b0 2023-03-03T07:43:40.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.092+0000 7fb011e66700 1 -- 172.21.15.57:0/1384787940 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb00c0992b0 msgr2=0x7fb00c099680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:40.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.092+0000 7fb011e66700 1 --2- 172.21.15.57:0/1384787940 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb00c0992b0 0x7fb00c099680 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb0000097d0 tx=0x7fb000009ae0 comp rx=0 tx=0).stop 2023-03-03T07:43:40.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.092+0000 7fb011e66700 1 -- 172.21.15.57:0/1384787940 shutdown_connections 2023-03-03T07:43:40.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.092+0000 7fb011e66700 1 --2- 172.21.15.57:0/1384787940 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb00c0992b0 0x7fb00c099680 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:40.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.092+0000 7fb011e66700 1 -- 172.21.15.57:0/1384787940 >> 172.21.15.57:0/1384787940 conn(0x7fb00c06cc70 msgr2=0x7fb00c06f080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:40.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.092+0000 7fb011e66700 1 -- 172.21.15.57:0/1384787940 shutdown_connections 2023-03-03T07:43:40.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.092+0000 7fb011e66700 1 -- 172.21.15.57:0/1384787940 wait complete. 2023-03-03T07:43:40.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.096+0000 7fb011e66700 1 Processor -- start 2023-03-03T07:43:40.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.096+0000 7fb011e66700 1 -- start start 2023-03-03T07:43:40.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.096+0000 7fb011e66700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb00c08e390 0x7fb00c1bbea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:40.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.096+0000 7fb011e66700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb00c097a60 con 0x7fb00c08e390 2023-03-03T07:43:40.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.100+0000 7fb010e64700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb00c08e390 0x7fb00c1bbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:40.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.100+0000 7fb010e64700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb00c08e390 0x7fb00c1bbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35602/0 (socket says 172.21.15.57:35602) 2023-03-03T07:43:40.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.100+0000 7fb010e64700 1 -- 172.21.15.57:0/1616254508 learned_addr learned my addr 172.21.15.57:0/1616254508 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:40.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.100+0000 7fb010e64700 1 -- 172.21.15.57:0/1616254508 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0000094b0 con 0x7fb00c08e390 2023-03-03T07:43:40.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.100+0000 7fb010e64700 1 --2- 172.21.15.57:0/1616254508 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb00c08e390 0x7fb00c1bbea0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb000009b20 tx=0x7fb000004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:40.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.100+0000 7fb0097fa700 1 -- 172.21.15.57:0/1616254508 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb000006ea0 con 0x7fb00c08e390 2023-03-03T07:43:40.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.100+0000 7fb0097fa700 1 -- 172.21.15.57:0/1616254508 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb000011630 con 0x7fb00c08e390 2023-03-03T07:43:40.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.100+0000 7fb0097fa700 1 -- 172.21.15.57:0/1616254508 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb0000118d0 con 0x7fb00c08e390 2023-03-03T07:43:40.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.100+0000 7fb011e66700 1 -- 172.21.15.57:0/1616254508 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb00c099d50 con 0x7fb00c08e390 2023-03-03T07:43:40.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.100+0000 7fb011e66700 1 -- 172.21.15.57:0/1616254508 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb00c099bc0 con 0x7fb00c08e390 2023-03-03T07:43:40.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.104+0000 7fb0097fa700 1 -- 172.21.15.57:0/1616254508 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42205+0+0 (secure 0 0 0) 0x7fb00002d070 con 0x7fb00c08e390 2023-03-03T07:43:40.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.104+0000 7fb011e66700 1 -- 172.21.15.57:0/1616254508 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb00c08ef00 con 0x7fb00c08e390 2023-03-03T07:43:40.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.104+0000 7fb0097fa700 1 --2- 172.21.15.57:0/1616254508 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7faff0034840 0x7faff0036cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:40.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.104+0000 7fb0097fa700 1 -- 172.21.15.57:0/1616254508 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2928+0+0 (secure 0 0 0) 0x7fb000046ff0 con 0x7fb00c08e390 2023-03-03T07:43:40.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.104+0000 7fb00bfff700 1 --2- 172.21.15.57:0/1616254508 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7faff0034840 0x7faff0036cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:40.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.104+0000 7fb00bfff700 1 --2- 172.21.15.57:0/1616254508 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7faff0034840 0x7faff0036cf0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7faff8000c00 tx=0x7faff80079c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:40.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.108+0000 7fb0097fa700 1 -- 172.21.15.57:0/1616254508 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb000077400 con 0x7fb00c08e390 2023-03-03T07:43:40.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.288+0000 7fb011e66700 1 -- 172.21.15.57:0/1616254508 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb00c0619b0 con 0x7fb00c08e390 2023-03-03T07:43:40.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.288+0000 7fb0097fa700 1 -- 172.21.15.57:0/1616254508 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+9544 (secure 0 0 0) 0x7fb000016020 con 0x7fb00c08e390 2023-03-03T07:43:40.295 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-03T07:43:40.295 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":16,"fsid":"5022d617-ad40-4ad9-8d5b-120958296d9c","created":"2023-03-03T07:43:13.256676+0000","modified":"2023-03-03T07:43:37.358119+0000","last_up_change":"2023-03-03T07:43:22.721740+0000","last_in_change":"2023-03-03T07:43:13.786190+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":1,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-03T07:43:22.864508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":1,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"9","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":1,"score_stable":1,"optimal_score":1,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-03T07:43:28.091327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":1,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1,"score_stable":1,"optimal_score":1,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-03T07:43:33.981804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":1,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1,"score_stable":1,"optimal_score":1,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-03T07:43:35.408700+0000","flags":1,"flags_names":"hashpspool","type":1,"size":1,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1,"score_stable":1,"optimal_score":1,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d83f7ba7-9d9d-4309-95b9-2b8ad96f2f8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":6,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":28687},{"type":"v1","addr":"172.21.15.57:6801","nonce":28687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":28687},{"type":"v1","addr":"172.21.15.57:6803","nonce":28687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":28687},{"type":"v1","addr":"172.21.15.57:6807","nonce":28687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":28687},{"type":"v1","addr":"172.21.15.57:6805","nonce":28687}]},"public_addr":"172.21.15.57:6801/28687","cluster_addr":"172.21.15.57:6803/28687","heartbeat_back_addr":"172.21.15.57:6807/28687","heartbeat_front_addr":"172.21.15.57:6805/28687","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T07:43:19.859898+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T07:43:40.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.292+0000 7fb011e66700 1 -- 172.21.15.57:0/1616254508 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7faff0034840 msgr2=0x7faff0036cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:40.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.292+0000 7fb011e66700 1 --2- 172.21.15.57:0/1616254508 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7faff0034840 0x7faff0036cf0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7faff8000c00 tx=0x7faff80079c0 comp rx=0 tx=0).stop 2023-03-03T07:43:40.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.292+0000 7fb011e66700 1 -- 172.21.15.57:0/1616254508 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb00c08e390 msgr2=0x7fb00c1bbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:40.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.292+0000 7fb011e66700 1 --2- 172.21.15.57:0/1616254508 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb00c08e390 0x7fb00c1bbea0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb000009b20 tx=0x7fb000004770 comp rx=0 tx=0).stop 2023-03-03T07:43:40.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.292+0000 7fb011e66700 1 -- 172.21.15.57:0/1616254508 shutdown_connections 2023-03-03T07:43:40.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.292+0000 7fb011e66700 1 --2- 172.21.15.57:0/1616254508 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7faff0034840 0x7faff0036cf0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:40.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.292+0000 7fb011e66700 1 --2- 172.21.15.57:0/1616254508 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb00c08e390 0x7fb00c1bbea0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:40.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.292+0000 7fb011e66700 1 -- 172.21.15.57:0/1616254508 >> 172.21.15.57:0/1616254508 conn(0x7fb00c06cc70 msgr2=0x7fb00c126610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:40.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.296+0000 7fb011e66700 1 -- 172.21.15.57:0/1616254508 shutdown_connections 2023-03-03T07:43:40.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.296+0000 7fb011e66700 1 -- 172.21.15.57:0/1616254508 wait complete. 2023-03-03T07:43:40.333 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-03-03T07:43:40.333 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-03T07:43:40.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.536+0000 7f63c990b700 1 Processor -- start 2023-03-03T07:43:40.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.536+0000 7f63c990b700 1 -- start start 2023-03-03T07:43:40.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.536+0000 7f63c990b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f63c412ab90 0x7f63c412cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:40.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.536+0000 7f63c990b700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63c4099d90 con 0x7f63c40992b0 2023-03-03T07:43:40.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.536+0000 7f63c990b700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63c4072220 con 0x7f63c412ab90 2023-03-03T07:43:40.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.536+0000 7f63c8909700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f63c40992b0 0x7f63c4099680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56790/0 (socket says 172.21.15.57:56790) 2023-03-03T07:43:40.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.536+0000 7f63c8909700 1 -- 172.21.15.57:0/2618996817 learned_addr learned my addr 172.21.15.57:0/2618996817 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:43:40.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.536+0000 7f63c3fff700 1 --2- 172.21.15.57:0/2618996817 >> v2:172.21.15.57:3300/0 conn(0x7f63c412ab90 0x7f63c412cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:40.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.536+0000 7f63c37fe700 1 -- 172.21.15.57:0/2618996817 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 608791287 0 0) 0x7f63c4099d90 con 0x7f63c40992b0 2023-03-03T07:43:40.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.536+0000 7f63c37fe700 1 -- 172.21.15.57:0/2618996817 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63b40035d0 con 0x7f63c40992b0 2023-03-03T07:43:40.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.540+0000 7f63c3fff700 1 -- 172.21.15.57:0/2618996817 >> v1:172.21.15.57:6789/0 conn(0x7f63c40992b0 legacy=0x7f63c4099680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:40.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.540+0000 7f63c3fff700 1 -- 172.21.15.57:0/2618996817 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c408f6a0 con 0x7f63c412ab90 2023-03-03T07:43:40.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.540+0000 7f63c3fff700 1 --2- 172.21.15.57:0/2618996817 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63c412ab90 0x7f63c412cf70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f63b00097d0 tx=0x7f63b0009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=542d380378bea0c server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:40.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.540+0000 7f63c37fe700 1 -- 172.21.15.57:0/2618996817 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f63b0004160 con 0x7f63c412ab90 2023-03-03T07:43:40.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.540+0000 7f63c37fe700 1 -- 172.21.15.57:0/2618996817 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63b00042c0 con 0x7f63c412ab90 2023-03-03T07:43:40.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.540+0000 7f63c37fe700 1 -- 172.21.15.57:0/2618996817 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f63b0004580 con 0x7f63c412ab90 2023-03-03T07:43:40.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.540+0000 7f63c990b700 1 -- 172.21.15.57:0/2618996817 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63c412ab90 msgr2=0x7f63c412cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:40.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.540+0000 7f63c990b700 1 --2- 172.21.15.57:0/2618996817 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63c412ab90 0x7f63c412cf70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f63b00097d0 tx=0x7f63b0009ae0 comp rx=0 tx=0).stop 2023-03-03T07:43:40.547 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.540+0000 7f63c990b700 1 -- 172.21.15.57:0/2618996817 shutdown_connections 2023-03-03T07:43:40.547 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.540+0000 7f63c990b700 1 --2- 172.21.15.57:0/2618996817 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63c412ab90 0x7f63c412cf70 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:40.547 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.540+0000 7f63c990b700 1 -- 172.21.15.57:0/2618996817 >> 172.21.15.57:0/2618996817 conn(0x7f63c406cc70 msgr2=0x7f63c406f080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:40.547 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.540+0000 7f63c990b700 1 -- 172.21.15.57:0/2618996817 shutdown_connections 2023-03-03T07:43:40.547 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.540+0000 7f63c990b700 1 -- 172.21.15.57:0/2618996817 wait complete. 2023-03-03T07:43:40.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.544+0000 7f63c990b700 1 Processor -- start 2023-03-03T07:43:40.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.544+0000 7f63c990b700 1 -- start start 2023-03-03T07:43:40.551 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.544+0000 7f63c990b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63c40992b0 0x7f63c41218f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:40.551 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.544+0000 7f63c990b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c4123f90 con 0x7f63c40992b0 2023-03-03T07:43:40.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.548+0000 7f63c8909700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63c40992b0 0x7f63c41218f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:40.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.548+0000 7f63c8909700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63c40992b0 0x7f63c41218f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35628/0 (socket says 172.21.15.57:35628) 2023-03-03T07:43:40.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.548+0000 7f63c8909700 1 -- 172.21.15.57:0/1009823071 learned_addr learned my addr 172.21.15.57:0/1009823071 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:40.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.548+0000 7f63c8909700 1 -- 172.21.15.57:0/1009823071 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b00094b0 con 0x7f63c40992b0 2023-03-03T07:43:40.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.548+0000 7f63c8909700 1 --2- 172.21.15.57:0/1009823071 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63c40992b0 0x7f63c41218f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f63b800c470 tx=0x7f63b800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:40.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.548+0000 7f63c17fa700 1 -- 172.21.15.57:0/1009823071 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f63b8005cc0 con 0x7f63c40992b0 2023-03-03T07:43:40.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.548+0000 7f63c17fa700 1 -- 172.21.15.57:0/1009823071 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63b8005e20 con 0x7f63c40992b0 2023-03-03T07:43:40.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.548+0000 7f63c17fa700 1 -- 172.21.15.57:0/1009823071 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f63b8007220 con 0x7f63c40992b0 2023-03-03T07:43:40.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.548+0000 7f63c990b700 1 -- 172.21.15.57:0/1009823071 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63c412d4b0 con 0x7f63c40992b0 2023-03-03T07:43:40.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.548+0000 7f63c990b700 1 -- 172.21.15.57:0/1009823071 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63c408f970 con 0x7f63c40992b0 2023-03-03T07:43:40.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.548+0000 7f63c17fa700 1 -- 172.21.15.57:0/1009823071 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42205+0+0 (secure 0 0 0) 0x7f63b8019030 con 0x7f63c40992b0 2023-03-03T07:43:40.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.548+0000 7f63c990b700 1 -- 172.21.15.57:0/1009823071 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63c412d640 con 0x7f63c40992b0 2023-03-03T07:43:40.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.552+0000 7f63c17fa700 1 --2- 172.21.15.57:0/1009823071 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f63a8034830 0x7f63a8036ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:40.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.552+0000 7f63c17fa700 1 -- 172.21.15.57:0/1009823071 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2928+0+0 (secure 0 0 0) 0x7f63b80454f0 con 0x7f63c40992b0 2023-03-03T07:43:40.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.552+0000 7f63c3fff700 1 --2- 172.21.15.57:0/1009823071 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f63a8034830 0x7f63a8036ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:40.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.552+0000 7f63c3fff700 1 --2- 172.21.15.57:0/1009823071 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f63a8034830 0x7f63a8036ce0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f63b00097d0 tx=0x7f63b0008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:40.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.560+0000 7f63c17fa700 1 -- 172.21.15.57:0/1009823071 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f63b80198b0 con 0x7f63c40992b0 2023-03-03T07:43:40.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.728+0000 7f63c990b700 1 -- 172.21.15.57:0/1009823071 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f63c40619b0 con 0x7f63a8034830 2023-03-03T07:43:40.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.748+0000 7f63c17fa700 1 -- 172.21.15.57:0/1009823071 <== mgr.4099 v2:172.21.15.57:6808/28565 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+263665 (secure 0 0 0) 0x7f63c40619b0 con 0x7f63a8034830 2023-03-03T07:43:40.755 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-03T07:43:40.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.756+0000 7f63c990b700 1 -- 172.21.15.57:0/1009823071 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f63a8034830 msgr2=0x7f63a8036ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:40.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.756+0000 7f63c990b700 1 --2- 172.21.15.57:0/1009823071 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f63a8034830 0x7f63a8036ce0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f63b00097d0 tx=0x7f63b0008030 comp rx=0 tx=0).stop 2023-03-03T07:43:40.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.756+0000 7f63c990b700 1 -- 172.21.15.57:0/1009823071 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63c40992b0 msgr2=0x7f63c41218f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:40.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.756+0000 7f63c990b700 1 --2- 172.21.15.57:0/1009823071 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63c40992b0 0x7f63c41218f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f63b800c470 tx=0x7f63b800c830 comp rx=0 tx=0).stop 2023-03-03T07:43:40.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.756+0000 7f63c990b700 1 -- 172.21.15.57:0/1009823071 shutdown_connections 2023-03-03T07:43:40.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.756+0000 7f63c990b700 1 --2- 172.21.15.57:0/1009823071 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f63a8034830 0x7f63a8036ce0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:40.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.756+0000 7f63c990b700 1 --2- 172.21.15.57:0/1009823071 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63c40992b0 0x7f63c41218f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:40.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.756+0000 7f63c990b700 1 -- 172.21.15.57:0/1009823071 >> 172.21.15.57:0/1009823071 conn(0x7f63c406cc70 msgr2=0x7f63c4129900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:40.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.756+0000 7f63c990b700 1 -- 172.21.15.57:0/1009823071 shutdown_connections 2023-03-03T07:43:40.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:40.756+0000 7f63c990b700 1 -- 172.21.15.57:0/1009823071 wait complete. 2023-03-03T07:43:40.765 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-03-03T07:43:40.795 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-03-03T07:43:38.753011+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":23,"num_object_clones":0,"num_object_copies":23,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":181,"num_write_kb":1908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":105,"acting":105,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":1048576,"kb_used":9260,"kb_used_data":740,"kb_used_omap":0,"kb_used_meta":8512,"kb_avail":1039316,"statfs":{"total":1073741824,"available":1064259584,"internally_reserved":0,"allocated":757760,"data_stored":627806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8716288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001110"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381705+0000","last_change":"2023-03-03T07:43:36.393637+0000","last_active":"2023-03-03T07:43:37.381705+0000","last_peered":"2023-03-03T07:43:37.381705+0000","last_clean":"2023-03-03T07:43:37.381705+0000","last_became_active":"2023-03-03T07:43:36.390086+0000","last_became_peered":"2023-03-03T07:43:36.390086+0000","last_unstale":"2023-03-03T07:43:37.381705+0000","last_undegraded":"2023-03-03T07:43:37.381705+0000","last_fullsized":"2023-03-03T07:43:37.381705+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:09:00.550158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378654+0000","last_change":"2023-03-03T07:43:36.387799+0000","last_active":"2023-03-03T07:43:37.378654+0000","last_peered":"2023-03-03T07:43:37.378654+0000","last_clean":"2023-03-03T07:43:37.378654+0000","last_became_active":"2023-03-03T07:43:36.386845+0000","last_became_peered":"2023-03-03T07:43:36.386845+0000","last_unstale":"2023-03-03T07:43:37.378654+0000","last_undegraded":"2023-03-03T07:43:37.378654+0000","last_fullsized":"2023-03-03T07:43:37.378654+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:17:33.673790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378497+0000","last_change":"2023-03-03T07:43:36.386277+0000","last_active":"2023-03-03T07:43:37.378497+0000","last_peered":"2023-03-03T07:43:37.378497+0000","last_clean":"2023-03-03T07:43:37.378497+0000","last_became_active":"2023-03-03T07:43:36.385656+0000","last_became_peered":"2023-03-03T07:43:36.385656+0000","last_unstale":"2023-03-03T07:43:37.378497+0000","last_undegraded":"2023-03-03T07:43:37.378497+0000","last_fullsized":"2023-03-03T07:43:37.378497+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:58:46.265569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378072+0000","last_change":"2023-03-03T07:43:36.386488+0000","last_active":"2023-03-03T07:43:37.378072+0000","last_peered":"2023-03-03T07:43:37.378072+0000","last_clean":"2023-03-03T07:43:37.378072+0000","last_became_active":"2023-03-03T07:43:36.385676+0000","last_became_peered":"2023-03-03T07:43:36.385676+0000","last_unstale":"2023-03-03T07:43:37.378072+0000","last_undegraded":"2023-03-03T07:43:37.378072+0000","last_fullsized":"2023-03-03T07:43:37.378072+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T19:10:46.103525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378425+0000","last_change":"2023-03-03T07:43:36.387609+0000","last_active":"2023-03-03T07:43:37.378425+0000","last_peered":"2023-03-03T07:43:37.378425+0000","last_clean":"2023-03-03T07:43:37.378425+0000","last_became_active":"2023-03-03T07:43:36.386787+0000","last_became_peered":"2023-03-03T07:43:36.386787+0000","last_unstale":"2023-03-03T07:43:37.378425+0000","last_undegraded":"2023-03-03T07:43:37.378425+0000","last_fullsized":"2023-03-03T07:43:37.378425+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:55:23.671272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377578+0000","last_change":"2023-03-03T07:43:36.391967+0000","last_active":"2023-03-03T07:43:37.377578+0000","last_peered":"2023-03-03T07:43:37.377578+0000","last_clean":"2023-03-03T07:43:37.377578+0000","last_became_active":"2023-03-03T07:43:36.388336+0000","last_became_peered":"2023-03-03T07:43:36.388336+0000","last_unstale":"2023-03-03T07:43:37.377578+0000","last_undegraded":"2023-03-03T07:43:37.377578+0000","last_fullsized":"2023-03-03T07:43:37.377578+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:00:15.483477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377385+0000","last_change":"2023-03-03T07:43:36.389899+0000","last_active":"2023-03-03T07:43:37.377385+0000","last_peered":"2023-03-03T07:43:37.377385+0000","last_clean":"2023-03-03T07:43:37.377385+0000","last_became_active":"2023-03-03T07:43:36.388351+0000","last_became_peered":"2023-03-03T07:43:36.388351+0000","last_unstale":"2023-03-03T07:43:37.377385+0000","last_undegraded":"2023-03-03T07:43:37.377385+0000","last_fullsized":"2023-03-03T07:43:37.377385+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:56:41.946658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377189+0000","last_change":"2023-03-03T07:43:36.384986+0000","last_active":"2023-03-03T07:43:37.377189+0000","last_peered":"2023-03-03T07:43:37.377189+0000","last_clean":"2023-03-03T07:43:37.377189+0000","last_became_active":"2023-03-03T07:43:36.383623+0000","last_became_peered":"2023-03-03T07:43:36.383623+0000","last_unstale":"2023-03-03T07:43:37.377189+0000","last_undegraded":"2023-03-03T07:43:37.377189+0000","last_fullsized":"2023-03-03T07:43:37.377189+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:23:12.419718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381830+0000","last_change":"2023-03-03T07:43:36.393726+0000","last_active":"2023-03-03T07:43:37.381830+0000","last_peered":"2023-03-03T07:43:37.381830+0000","last_clean":"2023-03-03T07:43:37.381830+0000","last_became_active":"2023-03-03T07:43:36.393246+0000","last_became_peered":"2023-03-03T07:43:36.393246+0000","last_unstale":"2023-03-03T07:43:37.381830+0000","last_undegraded":"2023-03-03T07:43:37.381830+0000","last_fullsized":"2023-03-03T07:43:37.381830+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:16:15.865411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378876+0000","last_change":"2023-03-03T07:43:36.386834+0000","last_active":"2023-03-03T07:43:37.378876+0000","last_peered":"2023-03-03T07:43:37.378876+0000","last_clean":"2023-03-03T07:43:37.378876+0000","last_became_active":"2023-03-03T07:43:36.386194+0000","last_became_peered":"2023-03-03T07:43:36.386194+0000","last_unstale":"2023-03-03T07:43:37.378876+0000","last_undegraded":"2023-03-03T07:43:37.378876+0000","last_fullsized":"2023-03-03T07:43:37.378876+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:55:32.472776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378632+0000","last_change":"2023-03-03T07:43:36.389629+0000","last_active":"2023-03-03T07:43:37.378632+0000","last_peered":"2023-03-03T07:43:37.378632+0000","last_clean":"2023-03-03T07:43:37.378632+0000","last_became_active":"2023-03-03T07:43:36.386514+0000","last_became_peered":"2023-03-03T07:43:36.386514+0000","last_unstale":"2023-03-03T07:43:37.378632+0000","last_undegraded":"2023-03-03T07:43:37.378632+0000","last_fullsized":"2023-03-03T07:43:37.378632+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:30:34.330114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378087+0000","last_change":"2023-03-03T07:43:36.392007+0000","last_active":"2023-03-03T07:43:37.378087+0000","last_peered":"2023-03-03T07:43:37.378087+0000","last_clean":"2023-03-03T07:43:37.378087+0000","last_became_active":"2023-03-03T07:43:36.387855+0000","last_became_peered":"2023-03-03T07:43:36.387855+0000","last_unstale":"2023-03-03T07:43:37.378087+0000","last_undegraded":"2023-03-03T07:43:37.378087+0000","last_fullsized":"2023-03-03T07:43:37.378087+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:36:55.997614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378670+0000","last_change":"2023-03-03T07:43:36.391658+0000","last_active":"2023-03-03T07:43:37.378670+0000","last_peered":"2023-03-03T07:43:37.378670+0000","last_clean":"2023-03-03T07:43:37.378670+0000","last_became_active":"2023-03-03T07:43:36.390126+0000","last_became_peered":"2023-03-03T07:43:36.390126+0000","last_unstale":"2023-03-03T07:43:37.378670+0000","last_undegraded":"2023-03-03T07:43:37.378670+0000","last_fullsized":"2023-03-03T07:43:37.378670+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:32:20.715403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377774+0000","last_change":"2023-03-03T07:43:36.381795+0000","last_active":"2023-03-03T07:43:37.377774+0000","last_peered":"2023-03-03T07:43:37.377774+0000","last_clean":"2023-03-03T07:43:37.377774+0000","last_became_active":"2023-03-03T07:43:36.380678+0000","last_became_peered":"2023-03-03T07:43:36.380678+0000","last_unstale":"2023-03-03T07:43:37.377774+0000","last_undegraded":"2023-03-03T07:43:37.377774+0000","last_fullsized":"2023-03-03T07:43:37.377774+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:49:53.962269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377318+0000","last_change":"2023-03-03T07:43:36.381452+0000","last_active":"2023-03-03T07:43:37.377318+0000","last_peered":"2023-03-03T07:43:37.377318+0000","last_clean":"2023-03-03T07:43:37.377318+0000","last_became_active":"2023-03-03T07:43:36.380631+0000","last_became_peered":"2023-03-03T07:43:36.380631+0000","last_unstale":"2023-03-03T07:43:37.377318+0000","last_undegraded":"2023-03-03T07:43:37.377318+0000","last_fullsized":"2023-03-03T07:43:37.377318+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:35:31.851815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378787+0000","last_change":"2023-03-03T07:43:36.386485+0000","last_active":"2023-03-03T07:43:37.378787+0000","last_peered":"2023-03-03T07:43:37.378787+0000","last_clean":"2023-03-03T07:43:37.378787+0000","last_became_active":"2023-03-03T07:43:36.385872+0000","last_became_peered":"2023-03-03T07:43:36.385872+0000","last_unstale":"2023-03-03T07:43:37.378787+0000","last_undegraded":"2023-03-03T07:43:37.378787+0000","last_fullsized":"2023-03-03T07:43:37.378787+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:40:02.564993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381949+0000","last_change":"2023-03-03T07:43:36.393749+0000","last_active":"2023-03-03T07:43:37.381949+0000","last_peered":"2023-03-03T07:43:37.381949+0000","last_clean":"2023-03-03T07:43:37.381949+0000","last_became_active":"2023-03-03T07:43:36.393288+0000","last_became_peered":"2023-03-03T07:43:36.393288+0000","last_unstale":"2023-03-03T07:43:37.381949+0000","last_undegraded":"2023-03-03T07:43:37.381949+0000","last_fullsized":"2023-03-03T07:43:37.381949+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:17:21.911716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379562+0000","last_change":"2023-03-03T07:43:36.391355+0000","last_active":"2023-03-03T07:43:37.379562+0000","last_peered":"2023-03-03T07:43:37.379562+0000","last_clean":"2023-03-03T07:43:37.379562+0000","last_became_active":"2023-03-03T07:43:36.387820+0000","last_became_peered":"2023-03-03T07:43:36.387820+0000","last_unstale":"2023-03-03T07:43:37.379562+0000","last_undegraded":"2023-03-03T07:43:37.379562+0000","last_fullsized":"2023-03-03T07:43:37.379562+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:22:59.608795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378766+0000","last_change":"2023-03-03T07:43:36.390057+0000","last_active":"2023-03-03T07:43:37.378766+0000","last_peered":"2023-03-03T07:43:37.378766+0000","last_clean":"2023-03-03T07:43:37.378766+0000","last_became_active":"2023-03-03T07:43:36.386741+0000","last_became_peered":"2023-03-03T07:43:36.386741+0000","last_unstale":"2023-03-03T07:43:37.378766+0000","last_undegraded":"2023-03-03T07:43:37.378766+0000","last_fullsized":"2023-03-03T07:43:37.378766+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:40:12.577170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378610+0000","last_change":"2023-03-03T07:43:36.393152+0000","last_active":"2023-03-03T07:43:37.378610+0000","last_peered":"2023-03-03T07:43:37.378610+0000","last_clean":"2023-03-03T07:43:37.378610+0000","last_became_active":"2023-03-03T07:43:36.388370+0000","last_became_peered":"2023-03-03T07:43:36.388370+0000","last_unstale":"2023-03-03T07:43:37.378610+0000","last_undegraded":"2023-03-03T07:43:37.378610+0000","last_fullsized":"2023-03-03T07:43:37.378610+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:52:19.250036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378810+0000","last_change":"2023-03-03T07:43:36.391466+0000","last_active":"2023-03-03T07:43:37.378810+0000","last_peered":"2023-03-03T07:43:37.378810+0000","last_clean":"2023-03-03T07:43:37.378810+0000","last_became_active":"2023-03-03T07:43:36.389987+0000","last_became_peered":"2023-03-03T07:43:36.389987+0000","last_unstale":"2023-03-03T07:43:37.378810+0000","last_undegraded":"2023-03-03T07:43:37.378810+0000","last_fullsized":"2023-03-03T07:43:37.378810+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:06:52.630210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377996+0000","last_change":"2023-03-03T07:43:36.383091+0000","last_active":"2023-03-03T07:43:37.377996+0000","last_peered":"2023-03-03T07:43:37.377996+0000","last_clean":"2023-03-03T07:43:37.377996+0000","last_became_active":"2023-03-03T07:43:36.380994+0000","last_became_peered":"2023-03-03T07:43:36.380994+0000","last_unstale":"2023-03-03T07:43:37.377996+0000","last_undegraded":"2023-03-03T07:43:37.377996+0000","last_fullsized":"2023-03-03T07:43:37.377996+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:18:41.788833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377524+0000","last_change":"2023-03-03T07:43:36.381681+0000","last_active":"2023-03-03T07:43:37.377524+0000","last_peered":"2023-03-03T07:43:37.377524+0000","last_clean":"2023-03-03T07:43:37.377524+0000","last_became_active":"2023-03-03T07:43:36.380651+0000","last_became_peered":"2023-03-03T07:43:36.380651+0000","last_unstale":"2023-03-03T07:43:37.377524+0000","last_undegraded":"2023-03-03T07:43:37.377524+0000","last_fullsized":"2023-03-03T07:43:37.377524+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:54:39.635086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377877+0000","last_change":"2023-03-03T07:43:36.387612+0000","last_active":"2023-03-03T07:43:37.377877+0000","last_peered":"2023-03-03T07:43:37.377877+0000","last_clean":"2023-03-03T07:43:37.377877+0000","last_became_active":"2023-03-03T07:43:36.386495+0000","last_became_peered":"2023-03-03T07:43:36.386495+0000","last_unstale":"2023-03-03T07:43:37.377877+0000","last_undegraded":"2023-03-03T07:43:37.377877+0000","last_fullsized":"2023-03-03T07:43:37.377877+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:32:02.438980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378481+0000","last_change":"2023-03-03T07:43:36.393652+0000","last_active":"2023-03-03T07:43:37.378481+0000","last_peered":"2023-03-03T07:43:37.378481+0000","last_clean":"2023-03-03T07:43:37.378481+0000","last_became_active":"2023-03-03T07:43:36.392133+0000","last_became_peered":"2023-03-03T07:43:36.392133+0000","last_unstale":"2023-03-03T07:43:37.378481+0000","last_undegraded":"2023-03-03T07:43:37.378481+0000","last_fullsized":"2023-03-03T07:43:37.378481+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:11:04.212221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381267+0000","last_change":"2023-03-03T07:43:36.391612+0000","last_active":"2023-03-03T07:43:37.381267+0000","last_peered":"2023-03-03T07:43:37.381267+0000","last_clean":"2023-03-03T07:43:37.381267+0000","last_became_active":"2023-03-03T07:43:36.388016+0000","last_became_peered":"2023-03-03T07:43:36.388016+0000","last_unstale":"2023-03-03T07:43:37.381267+0000","last_undegraded":"2023-03-03T07:43:37.381267+0000","last_fullsized":"2023-03-03T07:43:37.381267+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:57:04.070413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381222+0000","last_change":"2023-03-03T07:43:36.391717+0000","last_active":"2023-03-03T07:43:37.381222+0000","last_peered":"2023-03-03T07:43:37.381222+0000","last_clean":"2023-03-03T07:43:37.381222+0000","last_became_active":"2023-03-03T07:43:36.389768+0000","last_became_peered":"2023-03-03T07:43:36.389768+0000","last_unstale":"2023-03-03T07:43:37.381222+0000","last_undegraded":"2023-03-03T07:43:37.381222+0000","last_fullsized":"2023-03-03T07:43:37.381222+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:55:53.276950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379612+0000","last_change":"2023-03-03T07:43:36.393425+0000","last_active":"2023-03-03T07:43:37.379612+0000","last_peered":"2023-03-03T07:43:37.379612+0000","last_clean":"2023-03-03T07:43:37.379612+0000","last_became_active":"2023-03-03T07:43:36.391732+0000","last_became_peered":"2023-03-03T07:43:36.391732+0000","last_unstale":"2023-03-03T07:43:37.379612+0000","last_undegraded":"2023-03-03T07:43:37.379612+0000","last_fullsized":"2023-03-03T07:43:37.379612+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:45:17.493745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379072+0000","last_change":"2023-03-03T07:43:36.391823+0000","last_active":"2023-03-03T07:43:37.379072+0000","last_peered":"2023-03-03T07:43:37.379072+0000","last_clean":"2023-03-03T07:43:37.379072+0000","last_became_active":"2023-03-03T07:43:36.390288+0000","last_became_peered":"2023-03-03T07:43:36.390288+0000","last_unstale":"2023-03-03T07:43:37.379072+0000","last_undegraded":"2023-03-03T07:43:37.379072+0000","last_fullsized":"2023-03-03T07:43:37.379072+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:01:41.404103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378369+0000","last_change":"2023-03-03T07:43:36.383274+0000","last_active":"2023-03-03T07:43:37.378369+0000","last_peered":"2023-03-03T07:43:37.378369+0000","last_clean":"2023-03-03T07:43:37.378369+0000","last_became_active":"2023-03-03T07:43:36.381293+0000","last_became_peered":"2023-03-03T07:43:36.381293+0000","last_unstale":"2023-03-03T07:43:37.378369+0000","last_undegraded":"2023-03-03T07:43:37.378369+0000","last_fullsized":"2023-03-03T07:43:37.378369+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:27:20.763746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377615+0000","last_change":"2023-03-03T07:43:36.382637+0000","last_active":"2023-03-03T07:43:37.377615+0000","last_peered":"2023-03-03T07:43:37.377615+0000","last_clean":"2023-03-03T07:43:37.377615+0000","last_became_active":"2023-03-03T07:43:36.380941+0000","last_became_peered":"2023-03-03T07:43:36.380941+0000","last_unstale":"2023-03-03T07:43:37.377615+0000","last_undegraded":"2023-03-03T07:43:37.377615+0000","last_fullsized":"2023-03-03T07:43:37.377615+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:44:54.128297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377722+0000","last_change":"2023-03-03T07:43:36.385403+0000","last_active":"2023-03-03T07:43:37.377722+0000","last_peered":"2023-03-03T07:43:37.377722+0000","last_clean":"2023-03-03T07:43:37.377722+0000","last_became_active":"2023-03-03T07:43:36.384809+0000","last_became_peered":"2023-03-03T07:43:36.384809+0000","last_unstale":"2023-03-03T07:43:37.377722+0000","last_undegraded":"2023-03-03T07:43:37.377722+0000","last_fullsized":"2023-03-03T07:43:37.377722+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:40:13.258572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379386+0000","last_change":"2023-03-03T07:43:36.393487+0000","last_active":"2023-03-03T07:43:37.379386+0000","last_peered":"2023-03-03T07:43:37.379386+0000","last_clean":"2023-03-03T07:43:37.379386+0000","last_became_active":"2023-03-03T07:43:36.391768+0000","last_became_peered":"2023-03-03T07:43:36.391768+0000","last_unstale":"2023-03-03T07:43:37.379386+0000","last_undegraded":"2023-03-03T07:43:37.379386+0000","last_fullsized":"2023-03-03T07:43:37.379386+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:06:47.610243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378943+0000","last_change":"2023-03-03T07:43:35.895264+0000","last_active":"2023-03-03T07:43:37.378943+0000","last_peered":"2023-03-03T07:43:37.378943+0000","last_clean":"2023-03-03T07:43:37.378943+0000","last_became_active":"2023-03-03T07:43:35.894159+0000","last_became_peered":"2023-03-03T07:43:35.894159+0000","last_unstale":"2023-03-03T07:43:37.378943+0000","last_undegraded":"2023-03-03T07:43:37.378943+0000","last_fullsized":"2023-03-03T07:43:37.378943+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:51:45.982631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378998+0000","last_change":"2023-03-03T07:43:36.390239+0000","last_active":"2023-03-03T07:43:37.378998+0000","last_peered":"2023-03-03T07:43:37.378998+0000","last_clean":"2023-03-03T07:43:37.378998+0000","last_became_active":"2023-03-03T07:43:36.387807+0000","last_became_peered":"2023-03-03T07:43:36.387807+0000","last_unstale":"2023-03-03T07:43:37.378998+0000","last_undegraded":"2023-03-03T07:43:37.378998+0000","last_fullsized":"2023-03-03T07:43:37.378998+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:03:09.938807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378723+0000","last_change":"2023-03-03T07:43:35.888766+0000","last_active":"2023-03-03T07:43:37.378723+0000","last_peered":"2023-03-03T07:43:37.378723+0000","last_clean":"2023-03-03T07:43:37.378723+0000","last_became_active":"2023-03-03T07:43:35.888475+0000","last_became_peered":"2023-03-03T07:43:35.888475+0000","last_unstale":"2023-03-03T07:43:37.378723+0000","last_undegraded":"2023-03-03T07:43:37.378723+0000","last_fullsized":"2023-03-03T07:43:37.378723+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:38:06.266060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381468+0000","last_change":"2023-03-03T07:43:36.392191+0000","last_active":"2023-03-03T07:43:37.381468+0000","last_peered":"2023-03-03T07:43:37.381468+0000","last_clean":"2023-03-03T07:43:37.381468+0000","last_became_active":"2023-03-03T07:43:36.391967+0000","last_became_peered":"2023-03-03T07:43:36.391967+0000","last_unstale":"2023-03-03T07:43:37.381468+0000","last_undegraded":"2023-03-03T07:43:37.381468+0000","last_fullsized":"2023-03-03T07:43:37.381468+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:05:12.083235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378253+0000","last_change":"2023-03-03T07:43:35.877502+0000","last_active":"2023-03-03T07:43:37.378253+0000","last_peered":"2023-03-03T07:43:37.378253+0000","last_clean":"2023-03-03T07:43:37.378253+0000","last_became_active":"2023-03-03T07:43:35.876095+0000","last_became_peered":"2023-03-03T07:43:35.876095+0000","last_unstale":"2023-03-03T07:43:37.378253+0000","last_undegraded":"2023-03-03T07:43:37.378253+0000","last_fullsized":"2023-03-03T07:43:37.378253+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:04:51.085090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381278+0000","last_change":"2023-03-03T07:43:36.388187+0000","last_active":"2023-03-03T07:43:37.381278+0000","last_peered":"2023-03-03T07:43:37.381278+0000","last_clean":"2023-03-03T07:43:37.381278+0000","last_became_active":"2023-03-03T07:43:36.385750+0000","last_became_peered":"2023-03-03T07:43:36.385750+0000","last_unstale":"2023-03-03T07:43:37.381278+0000","last_undegraded":"2023-03-03T07:43:37.381278+0000","last_fullsized":"2023-03-03T07:43:37.381278+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:53:04.087750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"15'8","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377423+0000","last_change":"2023-03-03T07:43:35.885608+0000","last_active":"2023-03-03T07:43:37.377423+0000","last_peered":"2023-03-03T07:43:37.377423+0000","last_clean":"2023-03-03T07:43:37.377423+0000","last_became_active":"2023-03-03T07:43:35.882827+0000","last_became_peered":"2023-03-03T07:43:35.882827+0000","last_unstale":"2023-03-03T07:43:37.377423+0000","last_undegraded":"2023-03-03T07:43:37.377423+0000","last_fullsized":"2023-03-03T07:43:37.377423+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:10:08.916806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381936+0000","last_change":"2023-03-03T07:43:35.895617+0000","last_active":"2023-03-03T07:43:37.381936+0000","last_peered":"2023-03-03T07:43:37.381936+0000","last_clean":"2023-03-03T07:43:37.381936+0000","last_became_active":"2023-03-03T07:43:35.894656+0000","last_became_peered":"2023-03-03T07:43:35.894656+0000","last_unstale":"2023-03-03T07:43:37.381936+0000","last_undegraded":"2023-03-03T07:43:37.381936+0000","last_fullsized":"2023-03-03T07:43:37.381936+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:16:23.316589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":1,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377586+0000","last_change":"2023-03-03T07:43:36.385247+0000","last_active":"2023-03-03T07:43:37.377586+0000","last_peered":"2023-03-03T07:43:37.377586+0000","last_clean":"2023-03-03T07:43:37.377586+0000","last_became_active":"2023-03-03T07:43:36.384566+0000","last_became_peered":"2023-03-03T07:43:36.384566+0000","last_unstale":"2023-03-03T07:43:37.377586+0000","last_undegraded":"2023-03-03T07:43:37.377586+0000","last_fullsized":"2023-03-03T07:43:37.377586+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:13:56.887766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381435+0000","last_change":"2023-03-03T07:43:35.896637+0000","last_active":"2023-03-03T07:43:37.381435+0000","last_peered":"2023-03-03T07:43:37.381435+0000","last_clean":"2023-03-03T07:43:37.381435+0000","last_became_active":"2023-03-03T07:43:35.896121+0000","last_became_peered":"2023-03-03T07:43:35.896121+0000","last_unstale":"2023-03-03T07:43:37.381435+0000","last_undegraded":"2023-03-03T07:43:37.381435+0000","last_fullsized":"2023-03-03T07:43:37.381435+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:48:03.998157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":1,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377802+0000","last_change":"2023-03-03T07:43:36.382904+0000","last_active":"2023-03-03T07:43:37.377802+0000","last_peered":"2023-03-03T07:43:37.377802+0000","last_clean":"2023-03-03T07:43:37.377802+0000","last_became_active":"2023-03-03T07:43:36.382660+0000","last_became_peered":"2023-03-03T07:43:36.382660+0000","last_unstale":"2023-03-03T07:43:37.377802+0000","last_undegraded":"2023-03-03T07:43:37.377802+0000","last_fullsized":"2023-03-03T07:43:37.377802+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:08:38.514550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379594+0000","last_change":"2023-03-03T07:43:35.895808+0000","last_active":"2023-03-03T07:43:37.379594+0000","last_peered":"2023-03-03T07:43:37.379594+0000","last_clean":"2023-03-03T07:43:37.379594+0000","last_became_active":"2023-03-03T07:43:35.895529+0000","last_became_peered":"2023-03-03T07:43:35.895529+0000","last_unstale":"2023-03-03T07:43:37.379594+0000","last_undegraded":"2023-03-03T07:43:37.379594+0000","last_fullsized":"2023-03-03T07:43:37.379594+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:42:17.118297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":1,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379159+0000","last_change":"2023-03-03T07:43:36.392148+0000","last_active":"2023-03-03T07:43:37.379159+0000","last_peered":"2023-03-03T07:43:37.379159+0000","last_clean":"2023-03-03T07:43:37.379159+0000","last_became_active":"2023-03-03T07:43:36.391440+0000","last_became_peered":"2023-03-03T07:43:36.391440+0000","last_unstale":"2023-03-03T07:43:37.379159+0000","last_undegraded":"2023-03-03T07:43:37.379159+0000","last_fullsized":"2023-03-03T07:43:37.379159+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:17:49.134435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379489+0000","last_change":"2023-03-03T07:43:35.895938+0000","last_active":"2023-03-03T07:43:37.379489+0000","last_peered":"2023-03-03T07:43:37.379489+0000","last_clean":"2023-03-03T07:43:37.379489+0000","last_became_active":"2023-03-03T07:43:35.895196+0000","last_became_peered":"2023-03-03T07:43:35.895196+0000","last_unstale":"2023-03-03T07:43:37.379489+0000","last_undegraded":"2023-03-03T07:43:37.379489+0000","last_fullsized":"2023-03-03T07:43:37.379489+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:09:18.543009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378191+0000","last_change":"2023-03-03T07:43:36.391749+0000","last_active":"2023-03-03T07:43:37.378191+0000","last_peered":"2023-03-03T07:43:37.378191+0000","last_clean":"2023-03-03T07:43:37.378191+0000","last_became_active":"2023-03-03T07:43:36.389888+0000","last_became_peered":"2023-03-03T07:43:36.389888+0000","last_unstale":"2023-03-03T07:43:37.378191+0000","last_undegraded":"2023-03-03T07:43:37.378191+0000","last_fullsized":"2023-03-03T07:43:37.378191+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:06:24.364753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"15'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379694+0000","last_change":"2023-03-03T07:43:35.895961+0000","last_active":"2023-03-03T07:43:37.379694+0000","last_peered":"2023-03-03T07:43:37.379694+0000","last_clean":"2023-03-03T07:43:37.379694+0000","last_became_active":"2023-03-03T07:43:35.894409+0000","last_became_peered":"2023-03-03T07:43:35.894409+0000","last_unstale":"2023-03-03T07:43:37.379694+0000","last_undegraded":"2023-03-03T07:43:37.379694+0000","last_fullsized":"2023-03-03T07:43:37.379694+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:34:04.674852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":1,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378795+0000","last_change":"2023-03-03T07:43:36.393323+0000","last_active":"2023-03-03T07:43:37.378795+0000","last_peered":"2023-03-03T07:43:37.378795+0000","last_clean":"2023-03-03T07:43:37.378795+0000","last_became_active":"2023-03-03T07:43:36.391375+0000","last_became_peered":"2023-03-03T07:43:36.391375+0000","last_unstale":"2023-03-03T07:43:37.378795+0000","last_undegraded":"2023-03-03T07:43:37.378795+0000","last_fullsized":"2023-03-03T07:43:37.378795+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:50:37.609201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378961+0000","last_change":"2023-03-03T07:43:35.894763+0000","last_active":"2023-03-03T07:43:37.378961+0000","last_peered":"2023-03-03T07:43:37.378961+0000","last_clean":"2023-03-03T07:43:37.378961+0000","last_became_active":"2023-03-03T07:43:35.894469+0000","last_became_peered":"2023-03-03T07:43:35.894469+0000","last_unstale":"2023-03-03T07:43:37.378961+0000","last_undegraded":"2023-03-03T07:43:37.378961+0000","last_fullsized":"2023-03-03T07:43:37.378961+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:36:02.233356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379216+0000","last_change":"2023-03-03T07:43:36.391367+0000","last_active":"2023-03-03T07:43:37.379216+0000","last_peered":"2023-03-03T07:43:37.379216+0000","last_clean":"2023-03-03T07:43:37.379216+0000","last_became_active":"2023-03-03T07:43:36.388116+0000","last_became_peered":"2023-03-03T07:43:36.388116+0000","last_unstale":"2023-03-03T07:43:37.379216+0000","last_undegraded":"2023-03-03T07:43:37.379216+0000","last_fullsized":"2023-03-03T07:43:37.379216+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T19:18:26.044120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378275+0000","last_change":"2023-03-03T07:43:35.888682+0000","last_active":"2023-03-03T07:43:37.378275+0000","last_peered":"2023-03-03T07:43:37.378275+0000","last_clean":"2023-03-03T07:43:37.378275+0000","last_became_active":"2023-03-03T07:43:35.885672+0000","last_became_peered":"2023-03-03T07:43:35.885672+0000","last_unstale":"2023-03-03T07:43:37.378275+0000","last_undegraded":"2023-03-03T07:43:37.378275+0000","last_fullsized":"2023-03-03T07:43:37.378275+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:48:21.576840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379096+0000","last_change":"2023-03-03T07:43:36.387607+0000","last_active":"2023-03-03T07:43:37.379096+0000","last_peered":"2023-03-03T07:43:37.379096+0000","last_clean":"2023-03-03T07:43:37.379096+0000","last_became_active":"2023-03-03T07:43:36.386658+0000","last_became_peered":"2023-03-03T07:43:36.386658+0000","last_unstale":"2023-03-03T07:43:37.379096+0000","last_undegraded":"2023-03-03T07:43:37.379096+0000","last_fullsized":"2023-03-03T07:43:37.379096+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:05:06.641227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377419+0000","last_change":"2023-03-03T07:43:35.883415+0000","last_active":"2023-03-03T07:43:37.377419+0000","last_peered":"2023-03-03T07:43:37.377419+0000","last_clean":"2023-03-03T07:43:37.377419+0000","last_became_active":"2023-03-03T07:43:35.879803+0000","last_became_peered":"2023-03-03T07:43:35.879803+0000","last_unstale":"2023-03-03T07:43:37.377419+0000","last_undegraded":"2023-03-03T07:43:37.377419+0000","last_fullsized":"2023-03-03T07:43:37.377419+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:53:09.101814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381434+0000","last_change":"2023-03-03T07:43:36.393515+0000","last_active":"2023-03-03T07:43:37.381434+0000","last_peered":"2023-03-03T07:43:37.381434+0000","last_clean":"2023-03-03T07:43:37.381434+0000","last_became_active":"2023-03-03T07:43:36.386953+0000","last_became_peered":"2023-03-03T07:43:36.386953+0000","last_unstale":"2023-03-03T07:43:37.381434+0000","last_undegraded":"2023-03-03T07:43:37.381434+0000","last_fullsized":"2023-03-03T07:43:37.381434+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:26:22.884535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"8'97","reported_seq":143,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-03-03T07:43:36.365033+0000","last_change":"2023-03-03T07:43:24.771480+0000","last_active":"2023-03-03T07:43:36.365033+0000","last_peered":"2023-03-03T07:43:36.365033+0000","last_clean":"2023-03-03T07:43:36.365033+0000","last_became_active":"2023-03-03T07:43:24.770862+0000","last_became_peered":"2023-03-03T07:43:24.770862+0000","last_unstale":"2023-03-03T07:43:36.365033+0000","last_undegraded":"2023-03-03T07:43:36.365033+0000","last_fullsized":"2023-03-03T07:43:36.365033+0000","mapping_epoch":7,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":8,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:23.755169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:23.755169+0000","last_clean_scrub_stamp":"2023-03-03T07:43:23.755169+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:20:16.340417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-03-03T07:43:36.373715+0000","last_change":"2023-03-03T07:43:29.819791+0000","last_active":"2023-03-03T07:43:36.373715+0000","last_peered":"2023-03-03T07:43:36.373715+0000","last_clean":"2023-03-03T07:43:36.373715+0000","last_became_active":"2023-03-03T07:43:29.819125+0000","last_became_peered":"2023-03-03T07:43:29.819125+0000","last_unstale":"2023-03-03T07:43:36.373715+0000","last_undegraded":"2023-03-03T07:43:36.373715+0000","last_fullsized":"2023-03-03T07:43:36.373715+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_clean_scrub_stamp":"2023-03-03T07:43:28.794012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:48:46.625707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379126+0000","last_change":"2023-03-03T07:43:35.893902+0000","last_active":"2023-03-03T07:43:37.379126+0000","last_peered":"2023-03-03T07:43:37.379126+0000","last_clean":"2023-03-03T07:43:37.379126+0000","last_became_active":"2023-03-03T07:43:35.893653+0000","last_became_peered":"2023-03-03T07:43:35.893653+0000","last_unstale":"2023-03-03T07:43:37.379126+0000","last_undegraded":"2023-03-03T07:43:37.379126+0000","last_fullsized":"2023-03-03T07:43:37.379126+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T19:12:31.497654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379473+0000","last_change":"2023-03-03T07:43:36.391576+0000","last_active":"2023-03-03T07:43:37.379473+0000","last_peered":"2023-03-03T07:43:37.379473+0000","last_clean":"2023-03-03T07:43:37.379473+0000","last_became_active":"2023-03-03T07:43:36.388391+0000","last_became_peered":"2023-03-03T07:43:36.388391+0000","last_unstale":"2023-03-03T07:43:37.379473+0000","last_undegraded":"2023-03-03T07:43:37.379473+0000","last_fullsized":"2023-03-03T07:43:37.379473+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:44:38.954038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-03-03T07:43:36.365185+0000","last_change":"2023-03-03T07:43:29.821593+0000","last_active":"2023-03-03T07:43:36.365185+0000","last_peered":"2023-03-03T07:43:36.365185+0000","last_clean":"2023-03-03T07:43:36.365185+0000","last_became_active":"2023-03-03T07:43:29.821155+0000","last_became_peered":"2023-03-03T07:43:29.821155+0000","last_unstale":"2023-03-03T07:43:36.365185+0000","last_undegraded":"2023-03-03T07:43:36.365185+0000","last_fullsized":"2023-03-03T07:43:36.365185+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_clean_scrub_stamp":"2023-03-03T07:43:28.794012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:16:45.103665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378480+0000","last_change":"2023-03-03T07:43:35.890752+0000","last_active":"2023-03-03T07:43:37.378480+0000","last_peered":"2023-03-03T07:43:37.378480+0000","last_clean":"2023-03-03T07:43:37.378480+0000","last_became_active":"2023-03-03T07:43:35.888875+0000","last_became_peered":"2023-03-03T07:43:35.888875+0000","last_unstale":"2023-03-03T07:43:37.378480+0000","last_undegraded":"2023-03-03T07:43:37.378480+0000","last_fullsized":"2023-03-03T07:43:37.378480+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:08:43.703528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379368+0000","last_change":"2023-03-03T07:43:36.392018+0000","last_active":"2023-03-03T07:43:37.379368+0000","last_peered":"2023-03-03T07:43:37.379368+0000","last_clean":"2023-03-03T07:43:37.379368+0000","last_became_active":"2023-03-03T07:43:36.389351+0000","last_became_peered":"2023-03-03T07:43:36.389351+0000","last_unstale":"2023-03-03T07:43:37.379368+0000","last_undegraded":"2023-03-03T07:43:37.379368+0000","last_fullsized":"2023-03-03T07:43:37.379368+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:52:03.369684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-03-03T07:43:36.373450+0000","last_change":"2023-03-03T07:43:29.820869+0000","last_active":"2023-03-03T07:43:36.373450+0000","last_peered":"2023-03-03T07:43:36.373450+0000","last_clean":"2023-03-03T07:43:36.373450+0000","last_became_active":"2023-03-03T07:43:29.820454+0000","last_became_peered":"2023-03-03T07:43:29.820454+0000","last_unstale":"2023-03-03T07:43:36.373450+0000","last_undegraded":"2023-03-03T07:43:36.373450+0000","last_fullsized":"2023-03-03T07:43:36.373450+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_clean_scrub_stamp":"2023-03-03T07:43:28.794012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:06:02.760825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377296+0000","last_change":"2023-03-03T07:43:35.888736+0000","last_active":"2023-03-03T07:43:37.377296+0000","last_peered":"2023-03-03T07:43:37.377296+0000","last_clean":"2023-03-03T07:43:37.377296+0000","last_became_active":"2023-03-03T07:43:35.884537+0000","last_became_peered":"2023-03-03T07:43:35.884537+0000","last_unstale":"2023-03-03T07:43:37.377296+0000","last_undegraded":"2023-03-03T07:43:37.377296+0000","last_fullsized":"2023-03-03T07:43:37.377296+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:33:42.799055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381565+0000","last_change":"2023-03-03T07:43:36.393538+0000","last_active":"2023-03-03T07:43:37.381565+0000","last_peered":"2023-03-03T07:43:37.381565+0000","last_clean":"2023-03-03T07:43:37.381565+0000","last_became_active":"2023-03-03T07:43:36.389830+0000","last_became_peered":"2023-03-03T07:43:36.389830+0000","last_unstale":"2023-03-03T07:43:37.381565+0000","last_undegraded":"2023-03-03T07:43:37.381565+0000","last_fullsized":"2023-03-03T07:43:37.381565+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:55:45.795027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-03-03T07:43:36.373791+0000","last_change":"2023-03-03T07:43:29.821156+0000","last_active":"2023-03-03T07:43:36.373791+0000","last_peered":"2023-03-03T07:43:36.373791+0000","last_clean":"2023-03-03T07:43:36.373791+0000","last_became_active":"2023-03-03T07:43:29.820471+0000","last_became_peered":"2023-03-03T07:43:29.820471+0000","last_unstale":"2023-03-03T07:43:36.373791+0000","last_undegraded":"2023-03-03T07:43:36.373791+0000","last_fullsized":"2023-03-03T07:43:36.373791+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_clean_scrub_stamp":"2023-03-03T07:43:28.794012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:37:24.335449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379199+0000","last_change":"2023-03-03T07:43:35.895634+0000","last_active":"2023-03-03T07:43:37.379199+0000","last_peered":"2023-03-03T07:43:37.379199+0000","last_clean":"2023-03-03T07:43:37.379199+0000","last_became_active":"2023-03-03T07:43:35.895036+0000","last_became_peered":"2023-03-03T07:43:35.895036+0000","last_unstale":"2023-03-03T07:43:37.379199+0000","last_undegraded":"2023-03-03T07:43:37.379199+0000","last_fullsized":"2023-03-03T07:43:37.379199+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:49:24.082901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378991+0000","last_change":"2023-03-03T07:43:36.393263+0000","last_active":"2023-03-03T07:43:37.378991+0000","last_peered":"2023-03-03T07:43:37.378991+0000","last_clean":"2023-03-03T07:43:37.378991+0000","last_became_active":"2023-03-03T07:43:36.389601+0000","last_became_peered":"2023-03-03T07:43:36.389601+0000","last_unstale":"2023-03-03T07:43:37.378991+0000","last_undegraded":"2023-03-03T07:43:37.378991+0000","last_fullsized":"2023-03-03T07:43:37.378991+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:01:37.629716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381257+0000","last_change":"2023-03-03T07:43:35.895765+0000","last_active":"2023-03-03T07:43:37.381257+0000","last_peered":"2023-03-03T07:43:37.381257+0000","last_clean":"2023-03-03T07:43:37.381257+0000","last_became_active":"2023-03-03T07:43:35.894899+0000","last_became_peered":"2023-03-03T07:43:35.894899+0000","last_unstale":"2023-03-03T07:43:37.381257+0000","last_undegraded":"2023-03-03T07:43:37.381257+0000","last_fullsized":"2023-03-03T07:43:37.381257+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:26:15.189150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-03-03T07:43:36.372489+0000","last_change":"2023-03-03T07:43:29.822165+0000","last_active":"2023-03-03T07:43:36.372489+0000","last_peered":"2023-03-03T07:43:36.372489+0000","last_clean":"2023-03-03T07:43:36.372489+0000","last_became_active":"2023-03-03T07:43:29.821857+0000","last_became_peered":"2023-03-03T07:43:29.821857+0000","last_unstale":"2023-03-03T07:43:36.372489+0000","last_undegraded":"2023-03-03T07:43:36.372489+0000","last_fullsized":"2023-03-03T07:43:36.372489+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_clean_scrub_stamp":"2023-03-03T07:43:28.794012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:25:47.435749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378190+0000","last_change":"2023-03-03T07:43:36.383035+0000","last_active":"2023-03-03T07:43:37.378190+0000","last_peered":"2023-03-03T07:43:37.378190+0000","last_clean":"2023-03-03T07:43:37.378190+0000","last_became_active":"2023-03-03T07:43:36.380972+0000","last_became_peered":"2023-03-03T07:43:36.380972+0000","last_unstale":"2023-03-03T07:43:37.378190+0000","last_undegraded":"2023-03-03T07:43:37.378190+0000","last_fullsized":"2023-03-03T07:43:37.378190+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:48:16.722595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379574+0000","last_change":"2023-03-03T07:43:35.896322+0000","last_active":"2023-03-03T07:43:37.379574+0000","last_peered":"2023-03-03T07:43:37.379574+0000","last_clean":"2023-03-03T07:43:37.379574+0000","last_became_active":"2023-03-03T07:43:35.895238+0000","last_became_peered":"2023-03-03T07:43:35.895238+0000","last_unstale":"2023-03-03T07:43:37.379574+0000","last_undegraded":"2023-03-03T07:43:37.379574+0000","last_fullsized":"2023-03-03T07:43:37.379574+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:51:03.914235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-03-03T07:43:36.375587+0000","last_change":"2023-03-03T07:43:29.820875+0000","last_active":"2023-03-03T07:43:36.375587+0000","last_peered":"2023-03-03T07:43:36.375587+0000","last_clean":"2023-03-03T07:43:36.375587+0000","last_became_active":"2023-03-03T07:43:29.820497+0000","last_became_peered":"2023-03-03T07:43:29.820497+0000","last_unstale":"2023-03-03T07:43:36.375587+0000","last_undegraded":"2023-03-03T07:43:36.375587+0000","last_fullsized":"2023-03-03T07:43:36.375587+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_clean_scrub_stamp":"2023-03-03T07:43:28.794012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:47:10.778507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378313+0000","last_change":"2023-03-03T07:43:36.389829+0000","last_active":"2023-03-03T07:43:37.378313+0000","last_peered":"2023-03-03T07:43:37.378313+0000","last_clean":"2023-03-03T07:43:37.378313+0000","last_became_active":"2023-03-03T07:43:36.389575+0000","last_became_peered":"2023-03-03T07:43:36.389575+0000","last_unstale":"2023-03-03T07:43:37.378313+0000","last_undegraded":"2023-03-03T07:43:37.378313+0000","last_fullsized":"2023-03-03T07:43:37.378313+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:19:30.092333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"15'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.382039+0000","last_change":"2023-03-03T07:43:35.895805+0000","last_active":"2023-03-03T07:43:37.382039+0000","last_peered":"2023-03-03T07:43:37.382039+0000","last_clean":"2023-03-03T07:43:37.382039+0000","last_became_active":"2023-03-03T07:43:35.894950+0000","last_became_peered":"2023-03-03T07:43:35.894950+0000","last_unstale":"2023-03-03T07:43:37.382039+0000","last_undegraded":"2023-03-03T07:43:37.382039+0000","last_fullsized":"2023-03-03T07:43:37.382039+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T19:14:52.719580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":1,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-03-03T07:43:36.375541+0000","last_change":"2023-03-03T07:43:29.821552+0000","last_active":"2023-03-03T07:43:36.375541+0000","last_peered":"2023-03-03T07:43:36.375541+0000","last_clean":"2023-03-03T07:43:36.375541+0000","last_became_active":"2023-03-03T07:43:29.820710+0000","last_became_peered":"2023-03-03T07:43:29.820710+0000","last_unstale":"2023-03-03T07:43:36.375541+0000","last_undegraded":"2023-03-03T07:43:36.375541+0000","last_fullsized":"2023-03-03T07:43:36.375541+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_clean_scrub_stamp":"2023-03-03T07:43:28.794012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T19:28:41.224615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377588+0000","last_change":"2023-03-03T07:43:36.385134+0000","last_active":"2023-03-03T07:43:37.377588+0000","last_peered":"2023-03-03T07:43:37.377588+0000","last_clean":"2023-03-03T07:43:37.377588+0000","last_became_active":"2023-03-03T07:43:36.384452+0000","last_became_peered":"2023-03-03T07:43:36.384452+0000","last_unstale":"2023-03-03T07:43:37.377588+0000","last_undegraded":"2023-03-03T07:43:37.377588+0000","last_fullsized":"2023-03-03T07:43:37.377588+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:48:13.186580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381549+0000","last_change":"2023-03-03T07:43:35.896493+0000","last_active":"2023-03-03T07:43:37.381549+0000","last_peered":"2023-03-03T07:43:37.381549+0000","last_clean":"2023-03-03T07:43:37.381549+0000","last_became_active":"2023-03-03T07:43:35.894837+0000","last_became_peered":"2023-03-03T07:43:35.894837+0000","last_unstale":"2023-03-03T07:43:37.381549+0000","last_undegraded":"2023-03-03T07:43:37.381549+0000","last_fullsized":"2023-03-03T07:43:37.381549+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:07:11.749055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-03-03T07:43:36.373487+0000","last_change":"2023-03-03T07:43:29.822831+0000","last_active":"2023-03-03T07:43:36.373487+0000","last_peered":"2023-03-03T07:43:36.373487+0000","last_clean":"2023-03-03T07:43:36.373487+0000","last_became_active":"2023-03-03T07:43:29.822123+0000","last_became_peered":"2023-03-03T07:43:29.822123+0000","last_unstale":"2023-03-03T07:43:36.373487+0000","last_undegraded":"2023-03-03T07:43:36.373487+0000","last_fullsized":"2023-03-03T07:43:36.373487+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_clean_scrub_stamp":"2023-03-03T07:43:28.794012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:22:14.249159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378057+0000","last_change":"2023-03-03T07:43:36.387892+0000","last_active":"2023-03-03T07:43:37.378057+0000","last_peered":"2023-03-03T07:43:37.378057+0000","last_clean":"2023-03-03T07:43:37.378057+0000","last_became_active":"2023-03-03T07:43:36.387614+0000","last_became_peered":"2023-03-03T07:43:36.387614+0000","last_unstale":"2023-03-03T07:43:37.378057+0000","last_undegraded":"2023-03-03T07:43:37.378057+0000","last_fullsized":"2023-03-03T07:43:37.378057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:27:19.301365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378039+0000","last_change":"2023-03-03T07:43:36.377558+0000","last_active":"2023-03-03T07:43:37.378039+0000","last_peered":"2023-03-03T07:43:37.378039+0000","last_clean":"2023-03-03T07:43:37.378039+0000","last_became_active":"2023-03-03T07:43:36.377338+0000","last_became_peered":"2023-03-03T07:43:36.377338+0000","last_unstale":"2023-03-03T07:43:37.378039+0000","last_undegraded":"2023-03-03T07:43:37.378039+0000","last_fullsized":"2023-03-03T07:43:37.378039+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:52:56.959518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"15'6","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379411+0000","last_change":"2023-03-03T07:43:35.895416+0000","last_active":"2023-03-03T07:43:37.379411+0000","last_peered":"2023-03-03T07:43:37.379411+0000","last_clean":"2023-03-03T07:43:37.379411+0000","last_became_active":"2023-03-03T07:43:35.895003+0000","last_became_peered":"2023-03-03T07:43:35.895003+0000","last_unstale":"2023-03-03T07:43:37.379411+0000","last_undegraded":"2023-03-03T07:43:37.379411+0000","last_fullsized":"2023-03-03T07:43:37.379411+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:01:35.747172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378917+0000","last_change":"2023-03-03T07:43:36.393271+0000","last_active":"2023-03-03T07:43:37.378917+0000","last_peered":"2023-03-03T07:43:37.378917+0000","last_clean":"2023-03-03T07:43:37.378917+0000","last_became_active":"2023-03-03T07:43:36.392090+0000","last_became_peered":"2023-03-03T07:43:36.392090+0000","last_unstale":"2023-03-03T07:43:37.378917+0000","last_undegraded":"2023-03-03T07:43:37.378917+0000","last_fullsized":"2023-03-03T07:43:37.378917+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:37:14.185390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"15'3","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379351+0000","last_change":"2023-03-03T07:43:35.895610+0000","last_active":"2023-03-03T07:43:37.379351+0000","last_peered":"2023-03-03T07:43:37.379351+0000","last_clean":"2023-03-03T07:43:37.379351+0000","last_became_active":"2023-03-03T07:43:35.894334+0000","last_became_peered":"2023-03-03T07:43:35.894334+0000","last_unstale":"2023-03-03T07:43:37.379351+0000","last_undegraded":"2023-03-03T07:43:37.379351+0000","last_fullsized":"2023-03-03T07:43:37.379351+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:05:19.182581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381310+0000","last_change":"2023-03-03T07:43:35.894489+0000","last_active":"2023-03-03T07:43:37.381310+0000","last_peered":"2023-03-03T07:43:37.381310+0000","last_clean":"2023-03-03T07:43:37.381310+0000","last_became_active":"2023-03-03T07:43:35.894246+0000","last_became_peered":"2023-03-03T07:43:35.894246+0000","last_unstale":"2023-03-03T07:43:37.381310+0000","last_undegraded":"2023-03-03T07:43:37.381310+0000","last_fullsized":"2023-03-03T07:43:37.381310+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:57:25.492548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377698+0000","last_change":"2023-03-03T07:43:36.382817+0000","last_active":"2023-03-03T07:43:37.377698+0000","last_peered":"2023-03-03T07:43:37.377698+0000","last_clean":"2023-03-03T07:43:37.377698+0000","last_became_active":"2023-03-03T07:43:36.381184+0000","last_became_peered":"2023-03-03T07:43:36.381184+0000","last_unstale":"2023-03-03T07:43:37.377698+0000","last_undegraded":"2023-03-03T07:43:37.377698+0000","last_fullsized":"2023-03-03T07:43:37.377698+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:48:21.525727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381814+0000","last_change":"2023-03-03T07:43:35.895790+0000","last_active":"2023-03-03T07:43:37.381814+0000","last_peered":"2023-03-03T07:43:37.381814+0000","last_clean":"2023-03-03T07:43:37.381814+0000","last_became_active":"2023-03-03T07:43:35.894635+0000","last_became_peered":"2023-03-03T07:43:35.894635+0000","last_unstale":"2023-03-03T07:43:37.381814+0000","last_undegraded":"2023-03-03T07:43:37.381814+0000","last_fullsized":"2023-03-03T07:43:37.381814+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:00:25.399331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377726+0000","last_change":"2023-03-03T07:43:36.385314+0000","last_active":"2023-03-03T07:43:37.377726+0000","last_peered":"2023-03-03T07:43:37.377726+0000","last_clean":"2023-03-03T07:43:37.377726+0000","last_became_active":"2023-03-03T07:43:36.384718+0000","last_became_peered":"2023-03-03T07:43:36.384718+0000","last_unstale":"2023-03-03T07:43:37.377726+0000","last_undegraded":"2023-03-03T07:43:37.377726+0000","last_fullsized":"2023-03-03T07:43:37.377726+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T19:26:37.184969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378596+0000","last_change":"2023-03-03T07:43:36.386105+0000","last_active":"2023-03-03T07:43:37.378596+0000","last_peered":"2023-03-03T07:43:37.378596+0000","last_clean":"2023-03-03T07:43:37.378596+0000","last_became_active":"2023-03-03T07:43:36.385731+0000","last_became_peered":"2023-03-03T07:43:36.385731+0000","last_unstale":"2023-03-03T07:43:37.378596+0000","last_undegraded":"2023-03-03T07:43:37.378596+0000","last_fullsized":"2023-03-03T07:43:37.378596+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T19:26:45.707634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377039+0000","last_change":"2023-03-03T07:43:35.885660+0000","last_active":"2023-03-03T07:43:37.377039+0000","last_peered":"2023-03-03T07:43:37.377039+0000","last_clean":"2023-03-03T07:43:37.377039+0000","last_became_active":"2023-03-03T07:43:35.883112+0000","last_became_peered":"2023-03-03T07:43:35.883112+0000","last_unstale":"2023-03-03T07:43:37.377039+0000","last_undegraded":"2023-03-03T07:43:37.377039+0000","last_fullsized":"2023-03-03T07:43:37.377039+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:00:22.463509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381401+0000","last_change":"2023-03-03T07:43:36.391839+0000","last_active":"2023-03-03T07:43:37.381401+0000","last_peered":"2023-03-03T07:43:37.381401+0000","last_clean":"2023-03-03T07:43:37.381401+0000","last_became_active":"2023-03-03T07:43:36.388296+0000","last_became_peered":"2023-03-03T07:43:36.388296+0000","last_unstale":"2023-03-03T07:43:37.381401+0000","last_undegraded":"2023-03-03T07:43:37.381401+0000","last_fullsized":"2023-03-03T07:43:37.381401+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:50:23.423175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377857+0000","last_change":"2023-03-03T07:43:35.888737+0000","last_active":"2023-03-03T07:43:37.377857+0000","last_peered":"2023-03-03T07:43:37.377857+0000","last_clean":"2023-03-03T07:43:37.377857+0000","last_became_active":"2023-03-03T07:43:35.886324+0000","last_became_peered":"2023-03-03T07:43:35.886324+0000","last_unstale":"2023-03-03T07:43:37.377857+0000","last_undegraded":"2023-03-03T07:43:37.377857+0000","last_fullsized":"2023-03-03T07:43:37.377857+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:17:39.088385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378888+0000","last_change":"2023-03-03T07:43:36.391334+0000","last_active":"2023-03-03T07:43:37.378888+0000","last_peered":"2023-03-03T07:43:37.378888+0000","last_clean":"2023-03-03T07:43:37.378888+0000","last_became_active":"2023-03-03T07:43:36.387583+0000","last_became_peered":"2023-03-03T07:43:36.387583+0000","last_unstale":"2023-03-03T07:43:37.378888+0000","last_undegraded":"2023-03-03T07:43:37.378888+0000","last_fullsized":"2023-03-03T07:43:37.378888+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:29:23.983350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378556+0000","last_change":"2023-03-03T07:43:35.888455+0000","last_active":"2023-03-03T07:43:37.378556+0000","last_peered":"2023-03-03T07:43:37.378556+0000","last_clean":"2023-03-03T07:43:37.378556+0000","last_became_active":"2023-03-03T07:43:35.888141+0000","last_became_peered":"2023-03-03T07:43:35.888141+0000","last_unstale":"2023-03-03T07:43:37.378556+0000","last_undegraded":"2023-03-03T07:43:37.378556+0000","last_fullsized":"2023-03-03T07:43:37.378556+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:16:28.849552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378309+0000","last_change":"2023-03-03T07:43:36.392205+0000","last_active":"2023-03-03T07:43:37.378309+0000","last_peered":"2023-03-03T07:43:37.378309+0000","last_clean":"2023-03-03T07:43:37.378309+0000","last_became_active":"2023-03-03T07:43:36.388128+0000","last_became_peered":"2023-03-03T07:43:36.388128+0000","last_unstale":"2023-03-03T07:43:37.378309+0000","last_undegraded":"2023-03-03T07:43:37.378309+0000","last_fullsized":"2023-03-03T07:43:37.378309+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:37:51.500144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378540+0000","last_change":"2023-03-03T07:43:35.893932+0000","last_active":"2023-03-03T07:43:37.378540+0000","last_peered":"2023-03-03T07:43:37.378540+0000","last_clean":"2023-03-03T07:43:37.378540+0000","last_became_active":"2023-03-03T07:43:35.893689+0000","last_became_peered":"2023-03-03T07:43:35.893689+0000","last_unstale":"2023-03-03T07:43:37.378540+0000","last_undegraded":"2023-03-03T07:43:37.378540+0000","last_fullsized":"2023-03-03T07:43:37.378540+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:26:49.876498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378002+0000","last_change":"2023-03-03T07:43:36.377538+0000","last_active":"2023-03-03T07:43:37.378002+0000","last_peered":"2023-03-03T07:43:37.378002+0000","last_clean":"2023-03-03T07:43:37.378002+0000","last_became_active":"2023-03-03T07:43:36.377279+0000","last_became_peered":"2023-03-03T07:43:36.377279+0000","last_unstale":"2023-03-03T07:43:37.378002+0000","last_undegraded":"2023-03-03T07:43:37.378002+0000","last_fullsized":"2023-03-03T07:43:37.378002+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:26:17.662598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379204+0000","last_change":"2023-03-03T07:43:35.893989+0000","last_active":"2023-03-03T07:43:37.379204+0000","last_peered":"2023-03-03T07:43:37.379204+0000","last_clean":"2023-03-03T07:43:37.379204+0000","last_became_active":"2023-03-03T07:43:35.893701+0000","last_became_peered":"2023-03-03T07:43:35.893701+0000","last_unstale":"2023-03-03T07:43:37.379204+0000","last_undegraded":"2023-03-03T07:43:37.379204+0000","last_fullsized":"2023-03-03T07:43:37.379204+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:59:24.744163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":1,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378705+0000","last_change":"2023-03-03T07:43:36.383356+0000","last_active":"2023-03-03T07:43:37.378705+0000","last_peered":"2023-03-03T07:43:37.378705+0000","last_clean":"2023-03-03T07:43:37.378705+0000","last_became_active":"2023-03-03T07:43:36.381546+0000","last_became_peered":"2023-03-03T07:43:36.381546+0000","last_unstale":"2023-03-03T07:43:37.378705+0000","last_undegraded":"2023-03-03T07:43:37.378705+0000","last_fullsized":"2023-03-03T07:43:37.378705+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:06:50.266644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"15'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379105+0000","last_change":"2023-03-03T07:43:35.894711+0000","last_active":"2023-03-03T07:43:37.379105+0000","last_peered":"2023-03-03T07:43:37.379105+0000","last_clean":"2023-03-03T07:43:37.379105+0000","last_became_active":"2023-03-03T07:43:35.893970+0000","last_became_peered":"2023-03-03T07:43:35.893970+0000","last_unstale":"2023-03-03T07:43:37.379105+0000","last_undegraded":"2023-03-03T07:43:37.379105+0000","last_fullsized":"2023-03-03T07:43:37.379105+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:17:16.461687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":1,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379601+0000","last_change":"2023-03-03T07:43:36.389431+0000","last_active":"2023-03-03T07:43:37.379601+0000","last_peered":"2023-03-03T07:43:37.379601+0000","last_clean":"2023-03-03T07:43:37.379601+0000","last_became_active":"2023-03-03T07:43:36.388088+0000","last_became_peered":"2023-03-03T07:43:36.388088+0000","last_unstale":"2023-03-03T07:43:37.379601+0000","last_undegraded":"2023-03-03T07:43:37.379601+0000","last_fullsized":"2023-03-03T07:43:37.379601+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:38:06.090984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381157+0000","last_change":"2023-03-03T07:43:35.896502+0000","last_active":"2023-03-03T07:43:37.381157+0000","last_peered":"2023-03-03T07:43:37.381157+0000","last_clean":"2023-03-03T07:43:37.381157+0000","last_became_active":"2023-03-03T07:43:35.896259+0000","last_became_peered":"2023-03-03T07:43:35.896259+0000","last_unstale":"2023-03-03T07:43:37.381157+0000","last_undegraded":"2023-03-03T07:43:37.381157+0000","last_fullsized":"2023-03-03T07:43:37.381157+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:16:57.833751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377310+0000","last_change":"2023-03-03T07:43:36.385037+0000","last_active":"2023-03-03T07:43:37.377310+0000","last_peered":"2023-03-03T07:43:37.377310+0000","last_clean":"2023-03-03T07:43:37.377310+0000","last_became_active":"2023-03-03T07:43:36.383754+0000","last_became_peered":"2023-03-03T07:43:36.383754+0000","last_unstale":"2023-03-03T07:43:37.377310+0000","last_undegraded":"2023-03-03T07:43:37.377310+0000","last_fullsized":"2023-03-03T07:43:37.377310+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:23:35.231949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381694+0000","last_change":"2023-03-03T07:43:35.895981+0000","last_active":"2023-03-03T07:43:37.381694+0000","last_peered":"2023-03-03T07:43:37.381694+0000","last_clean":"2023-03-03T07:43:37.381694+0000","last_became_active":"2023-03-03T07:43:35.895386+0000","last_became_peered":"2023-03-03T07:43:35.895386+0000","last_unstale":"2023-03-03T07:43:37.381694+0000","last_undegraded":"2023-03-03T07:43:37.381694+0000","last_fullsized":"2023-03-03T07:43:37.381694+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:55:52.173973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":1},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":32,"acting":32,"num_store_stats":1},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":8,"acting":8,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":1,"acting":1,"num_store_stats":1}],"osd_stats":[{"osd":0,"up_from":6,"seq":25769803781,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":1048576,"kb_used":9260,"kb_used_data":740,"kb_used_omap":0,"kb_used_meta":8512,"kb_avail":1039316,"statfs":{"total":1073741824,"available":1064259584,"internally_reserved":0,"allocated":757760,"data_stored":627806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8716288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-03T07:43:40.802 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-03T07:43:41.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.048+0000 7f599e33c700 1 Processor -- start 2023-03-03T07:43:41.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.048+0000 7f599e33c700 1 -- start start 2023-03-03T07:43:41.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.048+0000 7f599e33c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5998127e10 0x7f59981281e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:41.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.052+0000 7f599e33c700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f599808f730 con 0x7f599808e390 2023-03-03T07:43:41.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.052+0000 7f599e33c700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5998128720 con 0x7f5998127e10 2023-03-03T07:43:41.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.052+0000 7f599d33a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5998127e10 0x7f59981281e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:41.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.052+0000 7f599cb39700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f599808e390 0x7f599808e7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56800/0 (socket says 172.21.15.57:56800) 2023-03-03T07:43:41.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.052+0000 7f599cb39700 1 -- 172.21.15.57:0/1556295711 learned_addr learned my addr 172.21.15.57:0/1556295711 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:43:41.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.052+0000 7f598ffff700 1 -- 172.21.15.57:0/1556295711 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2486258831 0 0) 0x7f599808f730 con 0x7f599808e390 2023-03-03T07:43:41.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.052+0000 7f598ffff700 1 -- 172.21.15.57:0/1556295711 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59840035d0 con 0x7f599808e390 2023-03-03T07:43:41.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.052+0000 7f599d33a700 1 -- 172.21.15.57:0/1556295711 >> v1:172.21.15.57:6789/0 conn(0x7f599808e390 legacy=0x7f599808e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:41.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.052+0000 7f599d33a700 1 -- 172.21.15.57:0/1556295711 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f599808f990 con 0x7f5998127e10 2023-03-03T07:43:41.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.052+0000 7f599d33a700 1 --2- 172.21.15.57:0/1556295711 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5998127e10 0x7f59981281e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f59940097d0 tx=0x7f5994009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e9a043528af0632 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:41.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.052+0000 7f598ffff700 1 -- 172.21.15.57:0/1556295711 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5994004160 con 0x7f5998127e10 2023-03-03T07:43:41.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.052+0000 7f598ffff700 1 -- 172.21.15.57:0/1556295711 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59940042c0 con 0x7f5998127e10 2023-03-03T07:43:41.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.052+0000 7f598ffff700 1 -- 172.21.15.57:0/1556295711 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59940045a0 con 0x7f5998127e10 2023-03-03T07:43:41.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.056+0000 7f599e33c700 1 -- 172.21.15.57:0/1556295711 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5998127e10 msgr2=0x7f59981281e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:41.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.056+0000 7f599e33c700 1 --2- 172.21.15.57:0/1556295711 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5998127e10 0x7f59981281e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f59940097d0 tx=0x7f5994009ae0 comp rx=0 tx=0).stop 2023-03-03T07:43:41.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.056+0000 7f599e33c700 1 -- 172.21.15.57:0/1556295711 shutdown_connections 2023-03-03T07:43:41.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.056+0000 7f599e33c700 1 --2- 172.21.15.57:0/1556295711 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5998127e10 0x7f59981281e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:41.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.056+0000 7f599e33c700 1 -- 172.21.15.57:0/1556295711 >> 172.21.15.57:0/1556295711 conn(0x7f599806cc30 msgr2=0x7f599806f040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:41.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.056+0000 7f599e33c700 1 -- 172.21.15.57:0/1556295711 shutdown_connections 2023-03-03T07:43:41.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.056+0000 7f599e33c700 1 -- 172.21.15.57:0/1556295711 wait complete. 2023-03-03T07:43:41.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.060+0000 7f599e33c700 1 Processor -- start 2023-03-03T07:43:41.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.060+0000 7f599e33c700 1 -- start start 2023-03-03T07:43:41.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.060+0000 7f599e33c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f599808e390 0x7f5998091f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:41.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.060+0000 7f599e33c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5998092f60 con 0x7f599808e390 2023-03-03T07:43:41.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.060+0000 7f599d33a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f599808e390 0x7f5998091f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:41.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.060+0000 7f599d33a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f599808e390 0x7f5998091f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35646/0 (socket says 172.21.15.57:35646) 2023-03-03T07:43:41.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.060+0000 7f599d33a700 1 -- 172.21.15.57:0/3499738375 learned_addr learned my addr 172.21.15.57:0/3499738375 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:41.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.064+0000 7f599d33a700 1 -- 172.21.15.57:0/3499738375 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59940094b0 con 0x7f599808e390 2023-03-03T07:43:41.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.064+0000 7f599d33a700 1 --2- 172.21.15.57:0/3499738375 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f599808e390 0x7f5998091f30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f59940090b0 tx=0x7f5994004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:41.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.064+0000 7f598dffb700 1 -- 172.21.15.57:0/3499738375 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5994003c80 con 0x7f599808e390 2023-03-03T07:43:41.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.064+0000 7f598dffb700 1 -- 172.21.15.57:0/3499738375 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f599401f070 con 0x7f599808e390 2023-03-03T07:43:41.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.064+0000 7f599e33c700 1 -- 172.21.15.57:0/3499738375 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f599808eed0 con 0x7f599808e390 2023-03-03T07:43:41.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.064+0000 7f598dffb700 1 -- 172.21.15.57:0/3499738375 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5994011630 con 0x7f599808e390 2023-03-03T07:43:41.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.064+0000 7f599e33c700 1 -- 172.21.15.57:0/3499738375 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5998125780 con 0x7f599808e390 2023-03-03T07:43:41.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.064+0000 7f599e33c700 1 -- 172.21.15.57:0/3499738375 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f599808f060 con 0x7f599808e390 2023-03-03T07:43:41.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.064+0000 7f598dffb700 1 -- 172.21.15.57:0/3499738375 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42205+0+0 (secure 0 0 0) 0x7f599402a020 con 0x7f599808e390 2023-03-03T07:43:41.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.068+0000 7f598dffb700 1 --2- 172.21.15.57:0/3499738375 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f597c034830 0x7f597c036ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:41.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.068+0000 7f598dffb700 1 -- 172.21.15.57:0/3499738375 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2928+0+0 (secure 0 0 0) 0x7f5994047820 con 0x7f599808e390 2023-03-03T07:43:41.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.068+0000 7f599cb39700 1 --2- 172.21.15.57:0/3499738375 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f597c034830 0x7f597c036ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:41.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.068+0000 7f599cb39700 1 --2- 172.21.15.57:0/3499738375 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f597c034830 0x7f597c036ce0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f59880016d0 tx=0x7f5988007a20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:41.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.076+0000 7f598dffb700 1 -- 172.21.15.57:0/3499738375 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5994010380 con 0x7f599808e390 2023-03-03T07:43:41.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.252+0000 7f599e33c700 1 -- 172.21.15.57:0/3499738375 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5998073580 con 0x7f597c034830 2023-03-03T07:43:41.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.264+0000 7f598dffb700 1 -- 172.21.15.57:0/3499738375 <== mgr.4099 v2:172.21.15.57:6808/28565 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+263665 (secure 0 0 0) 0x7f5998073580 con 0x7f597c034830 2023-03-03T07:43:41.274 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-03T07:43:41.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.276+0000 7f599e33c700 1 -- 172.21.15.57:0/3499738375 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f597c034830 msgr2=0x7f597c036ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:41.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.276+0000 7f599e33c700 1 --2- 172.21.15.57:0/3499738375 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f597c034830 0x7f597c036ce0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f59880016d0 tx=0x7f5988007a20 comp rx=0 tx=0).stop 2023-03-03T07:43:41.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.276+0000 7f599e33c700 1 -- 172.21.15.57:0/3499738375 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f599808e390 msgr2=0x7f5998091f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:41.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.276+0000 7f599e33c700 1 --2- 172.21.15.57:0/3499738375 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f599808e390 0x7f5998091f30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f59940090b0 tx=0x7f5994004770 comp rx=0 tx=0).stop 2023-03-03T07:43:41.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.276+0000 7f599e33c700 1 -- 172.21.15.57:0/3499738375 shutdown_connections 2023-03-03T07:43:41.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.276+0000 7f599e33c700 1 --2- 172.21.15.57:0/3499738375 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f597c034830 0x7f597c036ce0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:41.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.276+0000 7f599e33c700 1 --2- 172.21.15.57:0/3499738375 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f599808e390 0x7f5998091f30 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:41.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.276+0000 7f599e33c700 1 -- 172.21.15.57:0/3499738375 >> 172.21.15.57:0/3499738375 conn(0x7f599806cc30 msgr2=0x7f599806f400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:41.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.276+0000 7f599e33c700 1 -- 172.21.15.57:0/3499738375 shutdown_connections 2023-03-03T07:43:41.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.276+0000 7f599e33c700 1 -- 172.21.15.57:0/3499738375 wait complete. 2023-03-03T07:43:41.284 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-03-03T07:43:41.316 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-03-03T07:43:40.753701+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":23,"num_object_clones":0,"num_object_copies":23,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":181,"num_write_kb":1908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":105,"acting":105,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":1048576,"kb_used":9260,"kb_used_data":740,"kb_used_omap":0,"kb_used_meta":8512,"kb_avail":1039316,"statfs":{"total":1073741824,"available":1064259584,"internally_reserved":0,"allocated":757760,"data_stored":627806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8716288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.901289"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381705+0000","last_change":"2023-03-03T07:43:36.393637+0000","last_active":"2023-03-03T07:43:37.381705+0000","last_peered":"2023-03-03T07:43:37.381705+0000","last_clean":"2023-03-03T07:43:37.381705+0000","last_became_active":"2023-03-03T07:43:36.390086+0000","last_became_peered":"2023-03-03T07:43:36.390086+0000","last_unstale":"2023-03-03T07:43:37.381705+0000","last_undegraded":"2023-03-03T07:43:37.381705+0000","last_fullsized":"2023-03-03T07:43:37.381705+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:09:00.550158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378654+0000","last_change":"2023-03-03T07:43:36.387799+0000","last_active":"2023-03-03T07:43:37.378654+0000","last_peered":"2023-03-03T07:43:37.378654+0000","last_clean":"2023-03-03T07:43:37.378654+0000","last_became_active":"2023-03-03T07:43:36.386845+0000","last_became_peered":"2023-03-03T07:43:36.386845+0000","last_unstale":"2023-03-03T07:43:37.378654+0000","last_undegraded":"2023-03-03T07:43:37.378654+0000","last_fullsized":"2023-03-03T07:43:37.378654+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:17:33.673790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378497+0000","last_change":"2023-03-03T07:43:36.386277+0000","last_active":"2023-03-03T07:43:37.378497+0000","last_peered":"2023-03-03T07:43:37.378497+0000","last_clean":"2023-03-03T07:43:37.378497+0000","last_became_active":"2023-03-03T07:43:36.385656+0000","last_became_peered":"2023-03-03T07:43:36.385656+0000","last_unstale":"2023-03-03T07:43:37.378497+0000","last_undegraded":"2023-03-03T07:43:37.378497+0000","last_fullsized":"2023-03-03T07:43:37.378497+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:58:46.265569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378072+0000","last_change":"2023-03-03T07:43:36.386488+0000","last_active":"2023-03-03T07:43:37.378072+0000","last_peered":"2023-03-03T07:43:37.378072+0000","last_clean":"2023-03-03T07:43:37.378072+0000","last_became_active":"2023-03-03T07:43:36.385676+0000","last_became_peered":"2023-03-03T07:43:36.385676+0000","last_unstale":"2023-03-03T07:43:37.378072+0000","last_undegraded":"2023-03-03T07:43:37.378072+0000","last_fullsized":"2023-03-03T07:43:37.378072+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T19:10:46.103525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378425+0000","last_change":"2023-03-03T07:43:36.387609+0000","last_active":"2023-03-03T07:43:37.378425+0000","last_peered":"2023-03-03T07:43:37.378425+0000","last_clean":"2023-03-03T07:43:37.378425+0000","last_became_active":"2023-03-03T07:43:36.386787+0000","last_became_peered":"2023-03-03T07:43:36.386787+0000","last_unstale":"2023-03-03T07:43:37.378425+0000","last_undegraded":"2023-03-03T07:43:37.378425+0000","last_fullsized":"2023-03-03T07:43:37.378425+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:55:23.671272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377578+0000","last_change":"2023-03-03T07:43:36.391967+0000","last_active":"2023-03-03T07:43:37.377578+0000","last_peered":"2023-03-03T07:43:37.377578+0000","last_clean":"2023-03-03T07:43:37.377578+0000","last_became_active":"2023-03-03T07:43:36.388336+0000","last_became_peered":"2023-03-03T07:43:36.388336+0000","last_unstale":"2023-03-03T07:43:37.377578+0000","last_undegraded":"2023-03-03T07:43:37.377578+0000","last_fullsized":"2023-03-03T07:43:37.377578+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:00:15.483477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377385+0000","last_change":"2023-03-03T07:43:36.389899+0000","last_active":"2023-03-03T07:43:37.377385+0000","last_peered":"2023-03-03T07:43:37.377385+0000","last_clean":"2023-03-03T07:43:37.377385+0000","last_became_active":"2023-03-03T07:43:36.388351+0000","last_became_peered":"2023-03-03T07:43:36.388351+0000","last_unstale":"2023-03-03T07:43:37.377385+0000","last_undegraded":"2023-03-03T07:43:37.377385+0000","last_fullsized":"2023-03-03T07:43:37.377385+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:56:41.946658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377189+0000","last_change":"2023-03-03T07:43:36.384986+0000","last_active":"2023-03-03T07:43:37.377189+0000","last_peered":"2023-03-03T07:43:37.377189+0000","last_clean":"2023-03-03T07:43:37.377189+0000","last_became_active":"2023-03-03T07:43:36.383623+0000","last_became_peered":"2023-03-03T07:43:36.383623+0000","last_unstale":"2023-03-03T07:43:37.377189+0000","last_undegraded":"2023-03-03T07:43:37.377189+0000","last_fullsized":"2023-03-03T07:43:37.377189+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:23:12.419718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381830+0000","last_change":"2023-03-03T07:43:36.393726+0000","last_active":"2023-03-03T07:43:37.381830+0000","last_peered":"2023-03-03T07:43:37.381830+0000","last_clean":"2023-03-03T07:43:37.381830+0000","last_became_active":"2023-03-03T07:43:36.393246+0000","last_became_peered":"2023-03-03T07:43:36.393246+0000","last_unstale":"2023-03-03T07:43:37.381830+0000","last_undegraded":"2023-03-03T07:43:37.381830+0000","last_fullsized":"2023-03-03T07:43:37.381830+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:16:15.865411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378876+0000","last_change":"2023-03-03T07:43:36.386834+0000","last_active":"2023-03-03T07:43:37.378876+0000","last_peered":"2023-03-03T07:43:37.378876+0000","last_clean":"2023-03-03T07:43:37.378876+0000","last_became_active":"2023-03-03T07:43:36.386194+0000","last_became_peered":"2023-03-03T07:43:36.386194+0000","last_unstale":"2023-03-03T07:43:37.378876+0000","last_undegraded":"2023-03-03T07:43:37.378876+0000","last_fullsized":"2023-03-03T07:43:37.378876+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:55:32.472776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378632+0000","last_change":"2023-03-03T07:43:36.389629+0000","last_active":"2023-03-03T07:43:37.378632+0000","last_peered":"2023-03-03T07:43:37.378632+0000","last_clean":"2023-03-03T07:43:37.378632+0000","last_became_active":"2023-03-03T07:43:36.386514+0000","last_became_peered":"2023-03-03T07:43:36.386514+0000","last_unstale":"2023-03-03T07:43:37.378632+0000","last_undegraded":"2023-03-03T07:43:37.378632+0000","last_fullsized":"2023-03-03T07:43:37.378632+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:30:34.330114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378087+0000","last_change":"2023-03-03T07:43:36.392007+0000","last_active":"2023-03-03T07:43:37.378087+0000","last_peered":"2023-03-03T07:43:37.378087+0000","last_clean":"2023-03-03T07:43:37.378087+0000","last_became_active":"2023-03-03T07:43:36.387855+0000","last_became_peered":"2023-03-03T07:43:36.387855+0000","last_unstale":"2023-03-03T07:43:37.378087+0000","last_undegraded":"2023-03-03T07:43:37.378087+0000","last_fullsized":"2023-03-03T07:43:37.378087+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:36:55.997614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378670+0000","last_change":"2023-03-03T07:43:36.391658+0000","last_active":"2023-03-03T07:43:37.378670+0000","last_peered":"2023-03-03T07:43:37.378670+0000","last_clean":"2023-03-03T07:43:37.378670+0000","last_became_active":"2023-03-03T07:43:36.390126+0000","last_became_peered":"2023-03-03T07:43:36.390126+0000","last_unstale":"2023-03-03T07:43:37.378670+0000","last_undegraded":"2023-03-03T07:43:37.378670+0000","last_fullsized":"2023-03-03T07:43:37.378670+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:32:20.715403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377774+0000","last_change":"2023-03-03T07:43:36.381795+0000","last_active":"2023-03-03T07:43:37.377774+0000","last_peered":"2023-03-03T07:43:37.377774+0000","last_clean":"2023-03-03T07:43:37.377774+0000","last_became_active":"2023-03-03T07:43:36.380678+0000","last_became_peered":"2023-03-03T07:43:36.380678+0000","last_unstale":"2023-03-03T07:43:37.377774+0000","last_undegraded":"2023-03-03T07:43:37.377774+0000","last_fullsized":"2023-03-03T07:43:37.377774+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:49:53.962269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377318+0000","last_change":"2023-03-03T07:43:36.381452+0000","last_active":"2023-03-03T07:43:37.377318+0000","last_peered":"2023-03-03T07:43:37.377318+0000","last_clean":"2023-03-03T07:43:37.377318+0000","last_became_active":"2023-03-03T07:43:36.380631+0000","last_became_peered":"2023-03-03T07:43:36.380631+0000","last_unstale":"2023-03-03T07:43:37.377318+0000","last_undegraded":"2023-03-03T07:43:37.377318+0000","last_fullsized":"2023-03-03T07:43:37.377318+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:35:31.851815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378787+0000","last_change":"2023-03-03T07:43:36.386485+0000","last_active":"2023-03-03T07:43:37.378787+0000","last_peered":"2023-03-03T07:43:37.378787+0000","last_clean":"2023-03-03T07:43:37.378787+0000","last_became_active":"2023-03-03T07:43:36.385872+0000","last_became_peered":"2023-03-03T07:43:36.385872+0000","last_unstale":"2023-03-03T07:43:37.378787+0000","last_undegraded":"2023-03-03T07:43:37.378787+0000","last_fullsized":"2023-03-03T07:43:37.378787+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:40:02.564993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381949+0000","last_change":"2023-03-03T07:43:36.393749+0000","last_active":"2023-03-03T07:43:37.381949+0000","last_peered":"2023-03-03T07:43:37.381949+0000","last_clean":"2023-03-03T07:43:37.381949+0000","last_became_active":"2023-03-03T07:43:36.393288+0000","last_became_peered":"2023-03-03T07:43:36.393288+0000","last_unstale":"2023-03-03T07:43:37.381949+0000","last_undegraded":"2023-03-03T07:43:37.381949+0000","last_fullsized":"2023-03-03T07:43:37.381949+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:17:21.911716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379562+0000","last_change":"2023-03-03T07:43:36.391355+0000","last_active":"2023-03-03T07:43:37.379562+0000","last_peered":"2023-03-03T07:43:37.379562+0000","last_clean":"2023-03-03T07:43:37.379562+0000","last_became_active":"2023-03-03T07:43:36.387820+0000","last_became_peered":"2023-03-03T07:43:36.387820+0000","last_unstale":"2023-03-03T07:43:37.379562+0000","last_undegraded":"2023-03-03T07:43:37.379562+0000","last_fullsized":"2023-03-03T07:43:37.379562+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:22:59.608795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378766+0000","last_change":"2023-03-03T07:43:36.390057+0000","last_active":"2023-03-03T07:43:37.378766+0000","last_peered":"2023-03-03T07:43:37.378766+0000","last_clean":"2023-03-03T07:43:37.378766+0000","last_became_active":"2023-03-03T07:43:36.386741+0000","last_became_peered":"2023-03-03T07:43:36.386741+0000","last_unstale":"2023-03-03T07:43:37.378766+0000","last_undegraded":"2023-03-03T07:43:37.378766+0000","last_fullsized":"2023-03-03T07:43:37.378766+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:40:12.577170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378610+0000","last_change":"2023-03-03T07:43:36.393152+0000","last_active":"2023-03-03T07:43:37.378610+0000","last_peered":"2023-03-03T07:43:37.378610+0000","last_clean":"2023-03-03T07:43:37.378610+0000","last_became_active":"2023-03-03T07:43:36.388370+0000","last_became_peered":"2023-03-03T07:43:36.388370+0000","last_unstale":"2023-03-03T07:43:37.378610+0000","last_undegraded":"2023-03-03T07:43:37.378610+0000","last_fullsized":"2023-03-03T07:43:37.378610+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:52:19.250036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378810+0000","last_change":"2023-03-03T07:43:36.391466+0000","last_active":"2023-03-03T07:43:37.378810+0000","last_peered":"2023-03-03T07:43:37.378810+0000","last_clean":"2023-03-03T07:43:37.378810+0000","last_became_active":"2023-03-03T07:43:36.389987+0000","last_became_peered":"2023-03-03T07:43:36.389987+0000","last_unstale":"2023-03-03T07:43:37.378810+0000","last_undegraded":"2023-03-03T07:43:37.378810+0000","last_fullsized":"2023-03-03T07:43:37.378810+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:06:52.630210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377996+0000","last_change":"2023-03-03T07:43:36.383091+0000","last_active":"2023-03-03T07:43:37.377996+0000","last_peered":"2023-03-03T07:43:37.377996+0000","last_clean":"2023-03-03T07:43:37.377996+0000","last_became_active":"2023-03-03T07:43:36.380994+0000","last_became_peered":"2023-03-03T07:43:36.380994+0000","last_unstale":"2023-03-03T07:43:37.377996+0000","last_undegraded":"2023-03-03T07:43:37.377996+0000","last_fullsized":"2023-03-03T07:43:37.377996+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:18:41.788833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377524+0000","last_change":"2023-03-03T07:43:36.381681+0000","last_active":"2023-03-03T07:43:37.377524+0000","last_peered":"2023-03-03T07:43:37.377524+0000","last_clean":"2023-03-03T07:43:37.377524+0000","last_became_active":"2023-03-03T07:43:36.380651+0000","last_became_peered":"2023-03-03T07:43:36.380651+0000","last_unstale":"2023-03-03T07:43:37.377524+0000","last_undegraded":"2023-03-03T07:43:37.377524+0000","last_fullsized":"2023-03-03T07:43:37.377524+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:54:39.635086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377877+0000","last_change":"2023-03-03T07:43:36.387612+0000","last_active":"2023-03-03T07:43:37.377877+0000","last_peered":"2023-03-03T07:43:37.377877+0000","last_clean":"2023-03-03T07:43:37.377877+0000","last_became_active":"2023-03-03T07:43:36.386495+0000","last_became_peered":"2023-03-03T07:43:36.386495+0000","last_unstale":"2023-03-03T07:43:37.377877+0000","last_undegraded":"2023-03-03T07:43:37.377877+0000","last_fullsized":"2023-03-03T07:43:37.377877+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:32:02.438980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378481+0000","last_change":"2023-03-03T07:43:36.393652+0000","last_active":"2023-03-03T07:43:37.378481+0000","last_peered":"2023-03-03T07:43:37.378481+0000","last_clean":"2023-03-03T07:43:37.378481+0000","last_became_active":"2023-03-03T07:43:36.392133+0000","last_became_peered":"2023-03-03T07:43:36.392133+0000","last_unstale":"2023-03-03T07:43:37.378481+0000","last_undegraded":"2023-03-03T07:43:37.378481+0000","last_fullsized":"2023-03-03T07:43:37.378481+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:11:04.212221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381267+0000","last_change":"2023-03-03T07:43:36.391612+0000","last_active":"2023-03-03T07:43:37.381267+0000","last_peered":"2023-03-03T07:43:37.381267+0000","last_clean":"2023-03-03T07:43:37.381267+0000","last_became_active":"2023-03-03T07:43:36.388016+0000","last_became_peered":"2023-03-03T07:43:36.388016+0000","last_unstale":"2023-03-03T07:43:37.381267+0000","last_undegraded":"2023-03-03T07:43:37.381267+0000","last_fullsized":"2023-03-03T07:43:37.381267+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:57:04.070413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381222+0000","last_change":"2023-03-03T07:43:36.391717+0000","last_active":"2023-03-03T07:43:37.381222+0000","last_peered":"2023-03-03T07:43:37.381222+0000","last_clean":"2023-03-03T07:43:37.381222+0000","last_became_active":"2023-03-03T07:43:36.389768+0000","last_became_peered":"2023-03-03T07:43:36.389768+0000","last_unstale":"2023-03-03T07:43:37.381222+0000","last_undegraded":"2023-03-03T07:43:37.381222+0000","last_fullsized":"2023-03-03T07:43:37.381222+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:55:53.276950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379612+0000","last_change":"2023-03-03T07:43:36.393425+0000","last_active":"2023-03-03T07:43:37.379612+0000","last_peered":"2023-03-03T07:43:37.379612+0000","last_clean":"2023-03-03T07:43:37.379612+0000","last_became_active":"2023-03-03T07:43:36.391732+0000","last_became_peered":"2023-03-03T07:43:36.391732+0000","last_unstale":"2023-03-03T07:43:37.379612+0000","last_undegraded":"2023-03-03T07:43:37.379612+0000","last_fullsized":"2023-03-03T07:43:37.379612+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:45:17.493745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379072+0000","last_change":"2023-03-03T07:43:36.391823+0000","last_active":"2023-03-03T07:43:37.379072+0000","last_peered":"2023-03-03T07:43:37.379072+0000","last_clean":"2023-03-03T07:43:37.379072+0000","last_became_active":"2023-03-03T07:43:36.390288+0000","last_became_peered":"2023-03-03T07:43:36.390288+0000","last_unstale":"2023-03-03T07:43:37.379072+0000","last_undegraded":"2023-03-03T07:43:37.379072+0000","last_fullsized":"2023-03-03T07:43:37.379072+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:01:41.404103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378369+0000","last_change":"2023-03-03T07:43:36.383274+0000","last_active":"2023-03-03T07:43:37.378369+0000","last_peered":"2023-03-03T07:43:37.378369+0000","last_clean":"2023-03-03T07:43:37.378369+0000","last_became_active":"2023-03-03T07:43:36.381293+0000","last_became_peered":"2023-03-03T07:43:36.381293+0000","last_unstale":"2023-03-03T07:43:37.378369+0000","last_undegraded":"2023-03-03T07:43:37.378369+0000","last_fullsized":"2023-03-03T07:43:37.378369+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:27:20.763746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377615+0000","last_change":"2023-03-03T07:43:36.382637+0000","last_active":"2023-03-03T07:43:37.377615+0000","last_peered":"2023-03-03T07:43:37.377615+0000","last_clean":"2023-03-03T07:43:37.377615+0000","last_became_active":"2023-03-03T07:43:36.380941+0000","last_became_peered":"2023-03-03T07:43:36.380941+0000","last_unstale":"2023-03-03T07:43:37.377615+0000","last_undegraded":"2023-03-03T07:43:37.377615+0000","last_fullsized":"2023-03-03T07:43:37.377615+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:44:54.128297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377722+0000","last_change":"2023-03-03T07:43:36.385403+0000","last_active":"2023-03-03T07:43:37.377722+0000","last_peered":"2023-03-03T07:43:37.377722+0000","last_clean":"2023-03-03T07:43:37.377722+0000","last_became_active":"2023-03-03T07:43:36.384809+0000","last_became_peered":"2023-03-03T07:43:36.384809+0000","last_unstale":"2023-03-03T07:43:37.377722+0000","last_undegraded":"2023-03-03T07:43:37.377722+0000","last_fullsized":"2023-03-03T07:43:37.377722+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:40:13.258572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379386+0000","last_change":"2023-03-03T07:43:36.393487+0000","last_active":"2023-03-03T07:43:37.379386+0000","last_peered":"2023-03-03T07:43:37.379386+0000","last_clean":"2023-03-03T07:43:37.379386+0000","last_became_active":"2023-03-03T07:43:36.391768+0000","last_became_peered":"2023-03-03T07:43:36.391768+0000","last_unstale":"2023-03-03T07:43:37.379386+0000","last_undegraded":"2023-03-03T07:43:37.379386+0000","last_fullsized":"2023-03-03T07:43:37.379386+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:06:47.610243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378943+0000","last_change":"2023-03-03T07:43:35.895264+0000","last_active":"2023-03-03T07:43:37.378943+0000","last_peered":"2023-03-03T07:43:37.378943+0000","last_clean":"2023-03-03T07:43:37.378943+0000","last_became_active":"2023-03-03T07:43:35.894159+0000","last_became_peered":"2023-03-03T07:43:35.894159+0000","last_unstale":"2023-03-03T07:43:37.378943+0000","last_undegraded":"2023-03-03T07:43:37.378943+0000","last_fullsized":"2023-03-03T07:43:37.378943+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:51:45.982631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378998+0000","last_change":"2023-03-03T07:43:36.390239+0000","last_active":"2023-03-03T07:43:37.378998+0000","last_peered":"2023-03-03T07:43:37.378998+0000","last_clean":"2023-03-03T07:43:37.378998+0000","last_became_active":"2023-03-03T07:43:36.387807+0000","last_became_peered":"2023-03-03T07:43:36.387807+0000","last_unstale":"2023-03-03T07:43:37.378998+0000","last_undegraded":"2023-03-03T07:43:37.378998+0000","last_fullsized":"2023-03-03T07:43:37.378998+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:03:09.938807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378723+0000","last_change":"2023-03-03T07:43:35.888766+0000","last_active":"2023-03-03T07:43:37.378723+0000","last_peered":"2023-03-03T07:43:37.378723+0000","last_clean":"2023-03-03T07:43:37.378723+0000","last_became_active":"2023-03-03T07:43:35.888475+0000","last_became_peered":"2023-03-03T07:43:35.888475+0000","last_unstale":"2023-03-03T07:43:37.378723+0000","last_undegraded":"2023-03-03T07:43:37.378723+0000","last_fullsized":"2023-03-03T07:43:37.378723+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:38:06.266060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381468+0000","last_change":"2023-03-03T07:43:36.392191+0000","last_active":"2023-03-03T07:43:37.381468+0000","last_peered":"2023-03-03T07:43:37.381468+0000","last_clean":"2023-03-03T07:43:37.381468+0000","last_became_active":"2023-03-03T07:43:36.391967+0000","last_became_peered":"2023-03-03T07:43:36.391967+0000","last_unstale":"2023-03-03T07:43:37.381468+0000","last_undegraded":"2023-03-03T07:43:37.381468+0000","last_fullsized":"2023-03-03T07:43:37.381468+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:05:12.083235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378253+0000","last_change":"2023-03-03T07:43:35.877502+0000","last_active":"2023-03-03T07:43:37.378253+0000","last_peered":"2023-03-03T07:43:37.378253+0000","last_clean":"2023-03-03T07:43:37.378253+0000","last_became_active":"2023-03-03T07:43:35.876095+0000","last_became_peered":"2023-03-03T07:43:35.876095+0000","last_unstale":"2023-03-03T07:43:37.378253+0000","last_undegraded":"2023-03-03T07:43:37.378253+0000","last_fullsized":"2023-03-03T07:43:37.378253+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:04:51.085090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381278+0000","last_change":"2023-03-03T07:43:36.388187+0000","last_active":"2023-03-03T07:43:37.381278+0000","last_peered":"2023-03-03T07:43:37.381278+0000","last_clean":"2023-03-03T07:43:37.381278+0000","last_became_active":"2023-03-03T07:43:36.385750+0000","last_became_peered":"2023-03-03T07:43:36.385750+0000","last_unstale":"2023-03-03T07:43:37.381278+0000","last_undegraded":"2023-03-03T07:43:37.381278+0000","last_fullsized":"2023-03-03T07:43:37.381278+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:53:04.087750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"15'8","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377423+0000","last_change":"2023-03-03T07:43:35.885608+0000","last_active":"2023-03-03T07:43:37.377423+0000","last_peered":"2023-03-03T07:43:37.377423+0000","last_clean":"2023-03-03T07:43:37.377423+0000","last_became_active":"2023-03-03T07:43:35.882827+0000","last_became_peered":"2023-03-03T07:43:35.882827+0000","last_unstale":"2023-03-03T07:43:37.377423+0000","last_undegraded":"2023-03-03T07:43:37.377423+0000","last_fullsized":"2023-03-03T07:43:37.377423+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:10:08.916806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381936+0000","last_change":"2023-03-03T07:43:35.895617+0000","last_active":"2023-03-03T07:43:37.381936+0000","last_peered":"2023-03-03T07:43:37.381936+0000","last_clean":"2023-03-03T07:43:37.381936+0000","last_became_active":"2023-03-03T07:43:35.894656+0000","last_became_peered":"2023-03-03T07:43:35.894656+0000","last_unstale":"2023-03-03T07:43:37.381936+0000","last_undegraded":"2023-03-03T07:43:37.381936+0000","last_fullsized":"2023-03-03T07:43:37.381936+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:16:23.316589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":1,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377586+0000","last_change":"2023-03-03T07:43:36.385247+0000","last_active":"2023-03-03T07:43:37.377586+0000","last_peered":"2023-03-03T07:43:37.377586+0000","last_clean":"2023-03-03T07:43:37.377586+0000","last_became_active":"2023-03-03T07:43:36.384566+0000","last_became_peered":"2023-03-03T07:43:36.384566+0000","last_unstale":"2023-03-03T07:43:37.377586+0000","last_undegraded":"2023-03-03T07:43:37.377586+0000","last_fullsized":"2023-03-03T07:43:37.377586+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:13:56.887766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381435+0000","last_change":"2023-03-03T07:43:35.896637+0000","last_active":"2023-03-03T07:43:37.381435+0000","last_peered":"2023-03-03T07:43:37.381435+0000","last_clean":"2023-03-03T07:43:37.381435+0000","last_became_active":"2023-03-03T07:43:35.896121+0000","last_became_peered":"2023-03-03T07:43:35.896121+0000","last_unstale":"2023-03-03T07:43:37.381435+0000","last_undegraded":"2023-03-03T07:43:37.381435+0000","last_fullsized":"2023-03-03T07:43:37.381435+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:48:03.998157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":1,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377802+0000","last_change":"2023-03-03T07:43:36.382904+0000","last_active":"2023-03-03T07:43:37.377802+0000","last_peered":"2023-03-03T07:43:37.377802+0000","last_clean":"2023-03-03T07:43:37.377802+0000","last_became_active":"2023-03-03T07:43:36.382660+0000","last_became_peered":"2023-03-03T07:43:36.382660+0000","last_unstale":"2023-03-03T07:43:37.377802+0000","last_undegraded":"2023-03-03T07:43:37.377802+0000","last_fullsized":"2023-03-03T07:43:37.377802+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:08:38.514550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379594+0000","last_change":"2023-03-03T07:43:35.895808+0000","last_active":"2023-03-03T07:43:37.379594+0000","last_peered":"2023-03-03T07:43:37.379594+0000","last_clean":"2023-03-03T07:43:37.379594+0000","last_became_active":"2023-03-03T07:43:35.895529+0000","last_became_peered":"2023-03-03T07:43:35.895529+0000","last_unstale":"2023-03-03T07:43:37.379594+0000","last_undegraded":"2023-03-03T07:43:37.379594+0000","last_fullsized":"2023-03-03T07:43:37.379594+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:42:17.118297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":1,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379159+0000","last_change":"2023-03-03T07:43:36.392148+0000","last_active":"2023-03-03T07:43:37.379159+0000","last_peered":"2023-03-03T07:43:37.379159+0000","last_clean":"2023-03-03T07:43:37.379159+0000","last_became_active":"2023-03-03T07:43:36.391440+0000","last_became_peered":"2023-03-03T07:43:36.391440+0000","last_unstale":"2023-03-03T07:43:37.379159+0000","last_undegraded":"2023-03-03T07:43:37.379159+0000","last_fullsized":"2023-03-03T07:43:37.379159+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:17:49.134435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379489+0000","last_change":"2023-03-03T07:43:35.895938+0000","last_active":"2023-03-03T07:43:37.379489+0000","last_peered":"2023-03-03T07:43:37.379489+0000","last_clean":"2023-03-03T07:43:37.379489+0000","last_became_active":"2023-03-03T07:43:35.895196+0000","last_became_peered":"2023-03-03T07:43:35.895196+0000","last_unstale":"2023-03-03T07:43:37.379489+0000","last_undegraded":"2023-03-03T07:43:37.379489+0000","last_fullsized":"2023-03-03T07:43:37.379489+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:09:18.543009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378191+0000","last_change":"2023-03-03T07:43:36.391749+0000","last_active":"2023-03-03T07:43:37.378191+0000","last_peered":"2023-03-03T07:43:37.378191+0000","last_clean":"2023-03-03T07:43:37.378191+0000","last_became_active":"2023-03-03T07:43:36.389888+0000","last_became_peered":"2023-03-03T07:43:36.389888+0000","last_unstale":"2023-03-03T07:43:37.378191+0000","last_undegraded":"2023-03-03T07:43:37.378191+0000","last_fullsized":"2023-03-03T07:43:37.378191+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:06:24.364753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"15'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379694+0000","last_change":"2023-03-03T07:43:35.895961+0000","last_active":"2023-03-03T07:43:37.379694+0000","last_peered":"2023-03-03T07:43:37.379694+0000","last_clean":"2023-03-03T07:43:37.379694+0000","last_became_active":"2023-03-03T07:43:35.894409+0000","last_became_peered":"2023-03-03T07:43:35.894409+0000","last_unstale":"2023-03-03T07:43:37.379694+0000","last_undegraded":"2023-03-03T07:43:37.379694+0000","last_fullsized":"2023-03-03T07:43:37.379694+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:34:04.674852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":1,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378795+0000","last_change":"2023-03-03T07:43:36.393323+0000","last_active":"2023-03-03T07:43:37.378795+0000","last_peered":"2023-03-03T07:43:37.378795+0000","last_clean":"2023-03-03T07:43:37.378795+0000","last_became_active":"2023-03-03T07:43:36.391375+0000","last_became_peered":"2023-03-03T07:43:36.391375+0000","last_unstale":"2023-03-03T07:43:37.378795+0000","last_undegraded":"2023-03-03T07:43:37.378795+0000","last_fullsized":"2023-03-03T07:43:37.378795+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:50:37.609201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378961+0000","last_change":"2023-03-03T07:43:35.894763+0000","last_active":"2023-03-03T07:43:37.378961+0000","last_peered":"2023-03-03T07:43:37.378961+0000","last_clean":"2023-03-03T07:43:37.378961+0000","last_became_active":"2023-03-03T07:43:35.894469+0000","last_became_peered":"2023-03-03T07:43:35.894469+0000","last_unstale":"2023-03-03T07:43:37.378961+0000","last_undegraded":"2023-03-03T07:43:37.378961+0000","last_fullsized":"2023-03-03T07:43:37.378961+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:36:02.233356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379216+0000","last_change":"2023-03-03T07:43:36.391367+0000","last_active":"2023-03-03T07:43:37.379216+0000","last_peered":"2023-03-03T07:43:37.379216+0000","last_clean":"2023-03-03T07:43:37.379216+0000","last_became_active":"2023-03-03T07:43:36.388116+0000","last_became_peered":"2023-03-03T07:43:36.388116+0000","last_unstale":"2023-03-03T07:43:37.379216+0000","last_undegraded":"2023-03-03T07:43:37.379216+0000","last_fullsized":"2023-03-03T07:43:37.379216+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T19:18:26.044120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378275+0000","last_change":"2023-03-03T07:43:35.888682+0000","last_active":"2023-03-03T07:43:37.378275+0000","last_peered":"2023-03-03T07:43:37.378275+0000","last_clean":"2023-03-03T07:43:37.378275+0000","last_became_active":"2023-03-03T07:43:35.885672+0000","last_became_peered":"2023-03-03T07:43:35.885672+0000","last_unstale":"2023-03-03T07:43:37.378275+0000","last_undegraded":"2023-03-03T07:43:37.378275+0000","last_fullsized":"2023-03-03T07:43:37.378275+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:48:21.576840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379096+0000","last_change":"2023-03-03T07:43:36.387607+0000","last_active":"2023-03-03T07:43:37.379096+0000","last_peered":"2023-03-03T07:43:37.379096+0000","last_clean":"2023-03-03T07:43:37.379096+0000","last_became_active":"2023-03-03T07:43:36.386658+0000","last_became_peered":"2023-03-03T07:43:36.386658+0000","last_unstale":"2023-03-03T07:43:37.379096+0000","last_undegraded":"2023-03-03T07:43:37.379096+0000","last_fullsized":"2023-03-03T07:43:37.379096+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:05:06.641227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377419+0000","last_change":"2023-03-03T07:43:35.883415+0000","last_active":"2023-03-03T07:43:37.377419+0000","last_peered":"2023-03-03T07:43:37.377419+0000","last_clean":"2023-03-03T07:43:37.377419+0000","last_became_active":"2023-03-03T07:43:35.879803+0000","last_became_peered":"2023-03-03T07:43:35.879803+0000","last_unstale":"2023-03-03T07:43:37.377419+0000","last_undegraded":"2023-03-03T07:43:37.377419+0000","last_fullsized":"2023-03-03T07:43:37.377419+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:53:09.101814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381434+0000","last_change":"2023-03-03T07:43:36.393515+0000","last_active":"2023-03-03T07:43:37.381434+0000","last_peered":"2023-03-03T07:43:37.381434+0000","last_clean":"2023-03-03T07:43:37.381434+0000","last_became_active":"2023-03-03T07:43:36.386953+0000","last_became_peered":"2023-03-03T07:43:36.386953+0000","last_unstale":"2023-03-03T07:43:37.381434+0000","last_undegraded":"2023-03-03T07:43:37.381434+0000","last_fullsized":"2023-03-03T07:43:37.381434+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:26:22.884535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"8'97","reported_seq":143,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-03-03T07:43:36.365033+0000","last_change":"2023-03-03T07:43:24.771480+0000","last_active":"2023-03-03T07:43:36.365033+0000","last_peered":"2023-03-03T07:43:36.365033+0000","last_clean":"2023-03-03T07:43:36.365033+0000","last_became_active":"2023-03-03T07:43:24.770862+0000","last_became_peered":"2023-03-03T07:43:24.770862+0000","last_unstale":"2023-03-03T07:43:36.365033+0000","last_undegraded":"2023-03-03T07:43:36.365033+0000","last_fullsized":"2023-03-03T07:43:36.365033+0000","mapping_epoch":7,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":8,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:23.755169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:23.755169+0000","last_clean_scrub_stamp":"2023-03-03T07:43:23.755169+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:20:16.340417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-03-03T07:43:36.373715+0000","last_change":"2023-03-03T07:43:29.819791+0000","last_active":"2023-03-03T07:43:36.373715+0000","last_peered":"2023-03-03T07:43:36.373715+0000","last_clean":"2023-03-03T07:43:36.373715+0000","last_became_active":"2023-03-03T07:43:29.819125+0000","last_became_peered":"2023-03-03T07:43:29.819125+0000","last_unstale":"2023-03-03T07:43:36.373715+0000","last_undegraded":"2023-03-03T07:43:36.373715+0000","last_fullsized":"2023-03-03T07:43:36.373715+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_clean_scrub_stamp":"2023-03-03T07:43:28.794012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:48:46.625707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379126+0000","last_change":"2023-03-03T07:43:35.893902+0000","last_active":"2023-03-03T07:43:37.379126+0000","last_peered":"2023-03-03T07:43:37.379126+0000","last_clean":"2023-03-03T07:43:37.379126+0000","last_became_active":"2023-03-03T07:43:35.893653+0000","last_became_peered":"2023-03-03T07:43:35.893653+0000","last_unstale":"2023-03-03T07:43:37.379126+0000","last_undegraded":"2023-03-03T07:43:37.379126+0000","last_fullsized":"2023-03-03T07:43:37.379126+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T19:12:31.497654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379473+0000","last_change":"2023-03-03T07:43:36.391576+0000","last_active":"2023-03-03T07:43:37.379473+0000","last_peered":"2023-03-03T07:43:37.379473+0000","last_clean":"2023-03-03T07:43:37.379473+0000","last_became_active":"2023-03-03T07:43:36.388391+0000","last_became_peered":"2023-03-03T07:43:36.388391+0000","last_unstale":"2023-03-03T07:43:37.379473+0000","last_undegraded":"2023-03-03T07:43:37.379473+0000","last_fullsized":"2023-03-03T07:43:37.379473+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:44:38.954038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-03-03T07:43:36.365185+0000","last_change":"2023-03-03T07:43:29.821593+0000","last_active":"2023-03-03T07:43:36.365185+0000","last_peered":"2023-03-03T07:43:36.365185+0000","last_clean":"2023-03-03T07:43:36.365185+0000","last_became_active":"2023-03-03T07:43:29.821155+0000","last_became_peered":"2023-03-03T07:43:29.821155+0000","last_unstale":"2023-03-03T07:43:36.365185+0000","last_undegraded":"2023-03-03T07:43:36.365185+0000","last_fullsized":"2023-03-03T07:43:36.365185+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_clean_scrub_stamp":"2023-03-03T07:43:28.794012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:16:45.103665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378480+0000","last_change":"2023-03-03T07:43:35.890752+0000","last_active":"2023-03-03T07:43:37.378480+0000","last_peered":"2023-03-03T07:43:37.378480+0000","last_clean":"2023-03-03T07:43:37.378480+0000","last_became_active":"2023-03-03T07:43:35.888875+0000","last_became_peered":"2023-03-03T07:43:35.888875+0000","last_unstale":"2023-03-03T07:43:37.378480+0000","last_undegraded":"2023-03-03T07:43:37.378480+0000","last_fullsized":"2023-03-03T07:43:37.378480+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:08:43.703528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379368+0000","last_change":"2023-03-03T07:43:36.392018+0000","last_active":"2023-03-03T07:43:37.379368+0000","last_peered":"2023-03-03T07:43:37.379368+0000","last_clean":"2023-03-03T07:43:37.379368+0000","last_became_active":"2023-03-03T07:43:36.389351+0000","last_became_peered":"2023-03-03T07:43:36.389351+0000","last_unstale":"2023-03-03T07:43:37.379368+0000","last_undegraded":"2023-03-03T07:43:37.379368+0000","last_fullsized":"2023-03-03T07:43:37.379368+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:52:03.369684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-03-03T07:43:36.373450+0000","last_change":"2023-03-03T07:43:29.820869+0000","last_active":"2023-03-03T07:43:36.373450+0000","last_peered":"2023-03-03T07:43:36.373450+0000","last_clean":"2023-03-03T07:43:36.373450+0000","last_became_active":"2023-03-03T07:43:29.820454+0000","last_became_peered":"2023-03-03T07:43:29.820454+0000","last_unstale":"2023-03-03T07:43:36.373450+0000","last_undegraded":"2023-03-03T07:43:36.373450+0000","last_fullsized":"2023-03-03T07:43:36.373450+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_clean_scrub_stamp":"2023-03-03T07:43:28.794012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:06:02.760825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377296+0000","last_change":"2023-03-03T07:43:35.888736+0000","last_active":"2023-03-03T07:43:37.377296+0000","last_peered":"2023-03-03T07:43:37.377296+0000","last_clean":"2023-03-03T07:43:37.377296+0000","last_became_active":"2023-03-03T07:43:35.884537+0000","last_became_peered":"2023-03-03T07:43:35.884537+0000","last_unstale":"2023-03-03T07:43:37.377296+0000","last_undegraded":"2023-03-03T07:43:37.377296+0000","last_fullsized":"2023-03-03T07:43:37.377296+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:33:42.799055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381565+0000","last_change":"2023-03-03T07:43:36.393538+0000","last_active":"2023-03-03T07:43:37.381565+0000","last_peered":"2023-03-03T07:43:37.381565+0000","last_clean":"2023-03-03T07:43:37.381565+0000","last_became_active":"2023-03-03T07:43:36.389830+0000","last_became_peered":"2023-03-03T07:43:36.389830+0000","last_unstale":"2023-03-03T07:43:37.381565+0000","last_undegraded":"2023-03-03T07:43:37.381565+0000","last_fullsized":"2023-03-03T07:43:37.381565+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:55:45.795027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-03-03T07:43:36.373791+0000","last_change":"2023-03-03T07:43:29.821156+0000","last_active":"2023-03-03T07:43:36.373791+0000","last_peered":"2023-03-03T07:43:36.373791+0000","last_clean":"2023-03-03T07:43:36.373791+0000","last_became_active":"2023-03-03T07:43:29.820471+0000","last_became_peered":"2023-03-03T07:43:29.820471+0000","last_unstale":"2023-03-03T07:43:36.373791+0000","last_undegraded":"2023-03-03T07:43:36.373791+0000","last_fullsized":"2023-03-03T07:43:36.373791+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_clean_scrub_stamp":"2023-03-03T07:43:28.794012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:37:24.335449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379199+0000","last_change":"2023-03-03T07:43:35.895634+0000","last_active":"2023-03-03T07:43:37.379199+0000","last_peered":"2023-03-03T07:43:37.379199+0000","last_clean":"2023-03-03T07:43:37.379199+0000","last_became_active":"2023-03-03T07:43:35.895036+0000","last_became_peered":"2023-03-03T07:43:35.895036+0000","last_unstale":"2023-03-03T07:43:37.379199+0000","last_undegraded":"2023-03-03T07:43:37.379199+0000","last_fullsized":"2023-03-03T07:43:37.379199+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:49:24.082901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378991+0000","last_change":"2023-03-03T07:43:36.393263+0000","last_active":"2023-03-03T07:43:37.378991+0000","last_peered":"2023-03-03T07:43:37.378991+0000","last_clean":"2023-03-03T07:43:37.378991+0000","last_became_active":"2023-03-03T07:43:36.389601+0000","last_became_peered":"2023-03-03T07:43:36.389601+0000","last_unstale":"2023-03-03T07:43:37.378991+0000","last_undegraded":"2023-03-03T07:43:37.378991+0000","last_fullsized":"2023-03-03T07:43:37.378991+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:01:37.629716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381257+0000","last_change":"2023-03-03T07:43:35.895765+0000","last_active":"2023-03-03T07:43:37.381257+0000","last_peered":"2023-03-03T07:43:37.381257+0000","last_clean":"2023-03-03T07:43:37.381257+0000","last_became_active":"2023-03-03T07:43:35.894899+0000","last_became_peered":"2023-03-03T07:43:35.894899+0000","last_unstale":"2023-03-03T07:43:37.381257+0000","last_undegraded":"2023-03-03T07:43:37.381257+0000","last_fullsized":"2023-03-03T07:43:37.381257+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:26:15.189150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-03-03T07:43:36.372489+0000","last_change":"2023-03-03T07:43:29.822165+0000","last_active":"2023-03-03T07:43:36.372489+0000","last_peered":"2023-03-03T07:43:36.372489+0000","last_clean":"2023-03-03T07:43:36.372489+0000","last_became_active":"2023-03-03T07:43:29.821857+0000","last_became_peered":"2023-03-03T07:43:29.821857+0000","last_unstale":"2023-03-03T07:43:36.372489+0000","last_undegraded":"2023-03-03T07:43:36.372489+0000","last_fullsized":"2023-03-03T07:43:36.372489+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_clean_scrub_stamp":"2023-03-03T07:43:28.794012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:25:47.435749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378190+0000","last_change":"2023-03-03T07:43:36.383035+0000","last_active":"2023-03-03T07:43:37.378190+0000","last_peered":"2023-03-03T07:43:37.378190+0000","last_clean":"2023-03-03T07:43:37.378190+0000","last_became_active":"2023-03-03T07:43:36.380972+0000","last_became_peered":"2023-03-03T07:43:36.380972+0000","last_unstale":"2023-03-03T07:43:37.378190+0000","last_undegraded":"2023-03-03T07:43:37.378190+0000","last_fullsized":"2023-03-03T07:43:37.378190+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:48:16.722595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379574+0000","last_change":"2023-03-03T07:43:35.896322+0000","last_active":"2023-03-03T07:43:37.379574+0000","last_peered":"2023-03-03T07:43:37.379574+0000","last_clean":"2023-03-03T07:43:37.379574+0000","last_became_active":"2023-03-03T07:43:35.895238+0000","last_became_peered":"2023-03-03T07:43:35.895238+0000","last_unstale":"2023-03-03T07:43:37.379574+0000","last_undegraded":"2023-03-03T07:43:37.379574+0000","last_fullsized":"2023-03-03T07:43:37.379574+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:51:03.914235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-03-03T07:43:36.375587+0000","last_change":"2023-03-03T07:43:29.820875+0000","last_active":"2023-03-03T07:43:36.375587+0000","last_peered":"2023-03-03T07:43:36.375587+0000","last_clean":"2023-03-03T07:43:36.375587+0000","last_became_active":"2023-03-03T07:43:29.820497+0000","last_became_peered":"2023-03-03T07:43:29.820497+0000","last_unstale":"2023-03-03T07:43:36.375587+0000","last_undegraded":"2023-03-03T07:43:36.375587+0000","last_fullsized":"2023-03-03T07:43:36.375587+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_clean_scrub_stamp":"2023-03-03T07:43:28.794012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:47:10.778507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378313+0000","last_change":"2023-03-03T07:43:36.389829+0000","last_active":"2023-03-03T07:43:37.378313+0000","last_peered":"2023-03-03T07:43:37.378313+0000","last_clean":"2023-03-03T07:43:37.378313+0000","last_became_active":"2023-03-03T07:43:36.389575+0000","last_became_peered":"2023-03-03T07:43:36.389575+0000","last_unstale":"2023-03-03T07:43:37.378313+0000","last_undegraded":"2023-03-03T07:43:37.378313+0000","last_fullsized":"2023-03-03T07:43:37.378313+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:19:30.092333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"15'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.382039+0000","last_change":"2023-03-03T07:43:35.895805+0000","last_active":"2023-03-03T07:43:37.382039+0000","last_peered":"2023-03-03T07:43:37.382039+0000","last_clean":"2023-03-03T07:43:37.382039+0000","last_became_active":"2023-03-03T07:43:35.894950+0000","last_became_peered":"2023-03-03T07:43:35.894950+0000","last_unstale":"2023-03-03T07:43:37.382039+0000","last_undegraded":"2023-03-03T07:43:37.382039+0000","last_fullsized":"2023-03-03T07:43:37.382039+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T19:14:52.719580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":1,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-03-03T07:43:36.375541+0000","last_change":"2023-03-03T07:43:29.821552+0000","last_active":"2023-03-03T07:43:36.375541+0000","last_peered":"2023-03-03T07:43:36.375541+0000","last_clean":"2023-03-03T07:43:36.375541+0000","last_became_active":"2023-03-03T07:43:29.820710+0000","last_became_peered":"2023-03-03T07:43:29.820710+0000","last_unstale":"2023-03-03T07:43:36.375541+0000","last_undegraded":"2023-03-03T07:43:36.375541+0000","last_fullsized":"2023-03-03T07:43:36.375541+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_clean_scrub_stamp":"2023-03-03T07:43:28.794012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T19:28:41.224615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377588+0000","last_change":"2023-03-03T07:43:36.385134+0000","last_active":"2023-03-03T07:43:37.377588+0000","last_peered":"2023-03-03T07:43:37.377588+0000","last_clean":"2023-03-03T07:43:37.377588+0000","last_became_active":"2023-03-03T07:43:36.384452+0000","last_became_peered":"2023-03-03T07:43:36.384452+0000","last_unstale":"2023-03-03T07:43:37.377588+0000","last_undegraded":"2023-03-03T07:43:37.377588+0000","last_fullsized":"2023-03-03T07:43:37.377588+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:48:13.186580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381549+0000","last_change":"2023-03-03T07:43:35.896493+0000","last_active":"2023-03-03T07:43:37.381549+0000","last_peered":"2023-03-03T07:43:37.381549+0000","last_clean":"2023-03-03T07:43:37.381549+0000","last_became_active":"2023-03-03T07:43:35.894837+0000","last_became_peered":"2023-03-03T07:43:35.894837+0000","last_unstale":"2023-03-03T07:43:37.381549+0000","last_undegraded":"2023-03-03T07:43:37.381549+0000","last_fullsized":"2023-03-03T07:43:37.381549+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:07:11.749055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-03-03T07:43:36.373487+0000","last_change":"2023-03-03T07:43:29.822831+0000","last_active":"2023-03-03T07:43:36.373487+0000","last_peered":"2023-03-03T07:43:36.373487+0000","last_clean":"2023-03-03T07:43:36.373487+0000","last_became_active":"2023-03-03T07:43:29.822123+0000","last_became_peered":"2023-03-03T07:43:29.822123+0000","last_unstale":"2023-03-03T07:43:36.373487+0000","last_undegraded":"2023-03-03T07:43:36.373487+0000","last_fullsized":"2023-03-03T07:43:36.373487+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_clean_scrub_stamp":"2023-03-03T07:43:28.794012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:22:14.249159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378057+0000","last_change":"2023-03-03T07:43:36.387892+0000","last_active":"2023-03-03T07:43:37.378057+0000","last_peered":"2023-03-03T07:43:37.378057+0000","last_clean":"2023-03-03T07:43:37.378057+0000","last_became_active":"2023-03-03T07:43:36.387614+0000","last_became_peered":"2023-03-03T07:43:36.387614+0000","last_unstale":"2023-03-03T07:43:37.378057+0000","last_undegraded":"2023-03-03T07:43:37.378057+0000","last_fullsized":"2023-03-03T07:43:37.378057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:27:19.301365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378039+0000","last_change":"2023-03-03T07:43:36.377558+0000","last_active":"2023-03-03T07:43:37.378039+0000","last_peered":"2023-03-03T07:43:37.378039+0000","last_clean":"2023-03-03T07:43:37.378039+0000","last_became_active":"2023-03-03T07:43:36.377338+0000","last_became_peered":"2023-03-03T07:43:36.377338+0000","last_unstale":"2023-03-03T07:43:37.378039+0000","last_undegraded":"2023-03-03T07:43:37.378039+0000","last_fullsized":"2023-03-03T07:43:37.378039+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:52:56.959518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"15'6","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379411+0000","last_change":"2023-03-03T07:43:35.895416+0000","last_active":"2023-03-03T07:43:37.379411+0000","last_peered":"2023-03-03T07:43:37.379411+0000","last_clean":"2023-03-03T07:43:37.379411+0000","last_became_active":"2023-03-03T07:43:35.895003+0000","last_became_peered":"2023-03-03T07:43:35.895003+0000","last_unstale":"2023-03-03T07:43:37.379411+0000","last_undegraded":"2023-03-03T07:43:37.379411+0000","last_fullsized":"2023-03-03T07:43:37.379411+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:01:35.747172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378917+0000","last_change":"2023-03-03T07:43:36.393271+0000","last_active":"2023-03-03T07:43:37.378917+0000","last_peered":"2023-03-03T07:43:37.378917+0000","last_clean":"2023-03-03T07:43:37.378917+0000","last_became_active":"2023-03-03T07:43:36.392090+0000","last_became_peered":"2023-03-03T07:43:36.392090+0000","last_unstale":"2023-03-03T07:43:37.378917+0000","last_undegraded":"2023-03-03T07:43:37.378917+0000","last_fullsized":"2023-03-03T07:43:37.378917+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:37:14.185390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"15'3","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379351+0000","last_change":"2023-03-03T07:43:35.895610+0000","last_active":"2023-03-03T07:43:37.379351+0000","last_peered":"2023-03-03T07:43:37.379351+0000","last_clean":"2023-03-03T07:43:37.379351+0000","last_became_active":"2023-03-03T07:43:35.894334+0000","last_became_peered":"2023-03-03T07:43:35.894334+0000","last_unstale":"2023-03-03T07:43:37.379351+0000","last_undegraded":"2023-03-03T07:43:37.379351+0000","last_fullsized":"2023-03-03T07:43:37.379351+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:05:19.182581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381310+0000","last_change":"2023-03-03T07:43:35.894489+0000","last_active":"2023-03-03T07:43:37.381310+0000","last_peered":"2023-03-03T07:43:37.381310+0000","last_clean":"2023-03-03T07:43:37.381310+0000","last_became_active":"2023-03-03T07:43:35.894246+0000","last_became_peered":"2023-03-03T07:43:35.894246+0000","last_unstale":"2023-03-03T07:43:37.381310+0000","last_undegraded":"2023-03-03T07:43:37.381310+0000","last_fullsized":"2023-03-03T07:43:37.381310+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:57:25.492548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377698+0000","last_change":"2023-03-03T07:43:36.382817+0000","last_active":"2023-03-03T07:43:37.377698+0000","last_peered":"2023-03-03T07:43:37.377698+0000","last_clean":"2023-03-03T07:43:37.377698+0000","last_became_active":"2023-03-03T07:43:36.381184+0000","last_became_peered":"2023-03-03T07:43:36.381184+0000","last_unstale":"2023-03-03T07:43:37.377698+0000","last_undegraded":"2023-03-03T07:43:37.377698+0000","last_fullsized":"2023-03-03T07:43:37.377698+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:48:21.525727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381814+0000","last_change":"2023-03-03T07:43:35.895790+0000","last_active":"2023-03-03T07:43:37.381814+0000","last_peered":"2023-03-03T07:43:37.381814+0000","last_clean":"2023-03-03T07:43:37.381814+0000","last_became_active":"2023-03-03T07:43:35.894635+0000","last_became_peered":"2023-03-03T07:43:35.894635+0000","last_unstale":"2023-03-03T07:43:37.381814+0000","last_undegraded":"2023-03-03T07:43:37.381814+0000","last_fullsized":"2023-03-03T07:43:37.381814+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:00:25.399331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377726+0000","last_change":"2023-03-03T07:43:36.385314+0000","last_active":"2023-03-03T07:43:37.377726+0000","last_peered":"2023-03-03T07:43:37.377726+0000","last_clean":"2023-03-03T07:43:37.377726+0000","last_became_active":"2023-03-03T07:43:36.384718+0000","last_became_peered":"2023-03-03T07:43:36.384718+0000","last_unstale":"2023-03-03T07:43:37.377726+0000","last_undegraded":"2023-03-03T07:43:37.377726+0000","last_fullsized":"2023-03-03T07:43:37.377726+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T19:26:37.184969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378596+0000","last_change":"2023-03-03T07:43:36.386105+0000","last_active":"2023-03-03T07:43:37.378596+0000","last_peered":"2023-03-03T07:43:37.378596+0000","last_clean":"2023-03-03T07:43:37.378596+0000","last_became_active":"2023-03-03T07:43:36.385731+0000","last_became_peered":"2023-03-03T07:43:36.385731+0000","last_unstale":"2023-03-03T07:43:37.378596+0000","last_undegraded":"2023-03-03T07:43:37.378596+0000","last_fullsized":"2023-03-03T07:43:37.378596+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T19:26:45.707634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377039+0000","last_change":"2023-03-03T07:43:35.885660+0000","last_active":"2023-03-03T07:43:37.377039+0000","last_peered":"2023-03-03T07:43:37.377039+0000","last_clean":"2023-03-03T07:43:37.377039+0000","last_became_active":"2023-03-03T07:43:35.883112+0000","last_became_peered":"2023-03-03T07:43:35.883112+0000","last_unstale":"2023-03-03T07:43:37.377039+0000","last_undegraded":"2023-03-03T07:43:37.377039+0000","last_fullsized":"2023-03-03T07:43:37.377039+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:00:22.463509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381401+0000","last_change":"2023-03-03T07:43:36.391839+0000","last_active":"2023-03-03T07:43:37.381401+0000","last_peered":"2023-03-03T07:43:37.381401+0000","last_clean":"2023-03-03T07:43:37.381401+0000","last_became_active":"2023-03-03T07:43:36.388296+0000","last_became_peered":"2023-03-03T07:43:36.388296+0000","last_unstale":"2023-03-03T07:43:37.381401+0000","last_undegraded":"2023-03-03T07:43:37.381401+0000","last_fullsized":"2023-03-03T07:43:37.381401+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:50:23.423175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377857+0000","last_change":"2023-03-03T07:43:35.888737+0000","last_active":"2023-03-03T07:43:37.377857+0000","last_peered":"2023-03-03T07:43:37.377857+0000","last_clean":"2023-03-03T07:43:37.377857+0000","last_became_active":"2023-03-03T07:43:35.886324+0000","last_became_peered":"2023-03-03T07:43:35.886324+0000","last_unstale":"2023-03-03T07:43:37.377857+0000","last_undegraded":"2023-03-03T07:43:37.377857+0000","last_fullsized":"2023-03-03T07:43:37.377857+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:17:39.088385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378888+0000","last_change":"2023-03-03T07:43:36.391334+0000","last_active":"2023-03-03T07:43:37.378888+0000","last_peered":"2023-03-03T07:43:37.378888+0000","last_clean":"2023-03-03T07:43:37.378888+0000","last_became_active":"2023-03-03T07:43:36.387583+0000","last_became_peered":"2023-03-03T07:43:36.387583+0000","last_unstale":"2023-03-03T07:43:37.378888+0000","last_undegraded":"2023-03-03T07:43:37.378888+0000","last_fullsized":"2023-03-03T07:43:37.378888+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:29:23.983350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378556+0000","last_change":"2023-03-03T07:43:35.888455+0000","last_active":"2023-03-03T07:43:37.378556+0000","last_peered":"2023-03-03T07:43:37.378556+0000","last_clean":"2023-03-03T07:43:37.378556+0000","last_became_active":"2023-03-03T07:43:35.888141+0000","last_became_peered":"2023-03-03T07:43:35.888141+0000","last_unstale":"2023-03-03T07:43:37.378556+0000","last_undegraded":"2023-03-03T07:43:37.378556+0000","last_fullsized":"2023-03-03T07:43:37.378556+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:16:28.849552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378309+0000","last_change":"2023-03-03T07:43:36.392205+0000","last_active":"2023-03-03T07:43:37.378309+0000","last_peered":"2023-03-03T07:43:37.378309+0000","last_clean":"2023-03-03T07:43:37.378309+0000","last_became_active":"2023-03-03T07:43:36.388128+0000","last_became_peered":"2023-03-03T07:43:36.388128+0000","last_unstale":"2023-03-03T07:43:37.378309+0000","last_undegraded":"2023-03-03T07:43:37.378309+0000","last_fullsized":"2023-03-03T07:43:37.378309+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:37:51.500144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378540+0000","last_change":"2023-03-03T07:43:35.893932+0000","last_active":"2023-03-03T07:43:37.378540+0000","last_peered":"2023-03-03T07:43:37.378540+0000","last_clean":"2023-03-03T07:43:37.378540+0000","last_became_active":"2023-03-03T07:43:35.893689+0000","last_became_peered":"2023-03-03T07:43:35.893689+0000","last_unstale":"2023-03-03T07:43:37.378540+0000","last_undegraded":"2023-03-03T07:43:37.378540+0000","last_fullsized":"2023-03-03T07:43:37.378540+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:26:49.876498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378002+0000","last_change":"2023-03-03T07:43:36.377538+0000","last_active":"2023-03-03T07:43:37.378002+0000","last_peered":"2023-03-03T07:43:37.378002+0000","last_clean":"2023-03-03T07:43:37.378002+0000","last_became_active":"2023-03-03T07:43:36.377279+0000","last_became_peered":"2023-03-03T07:43:36.377279+0000","last_unstale":"2023-03-03T07:43:37.378002+0000","last_undegraded":"2023-03-03T07:43:37.378002+0000","last_fullsized":"2023-03-03T07:43:37.378002+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:26:17.662598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379204+0000","last_change":"2023-03-03T07:43:35.893989+0000","last_active":"2023-03-03T07:43:37.379204+0000","last_peered":"2023-03-03T07:43:37.379204+0000","last_clean":"2023-03-03T07:43:37.379204+0000","last_became_active":"2023-03-03T07:43:35.893701+0000","last_became_peered":"2023-03-03T07:43:35.893701+0000","last_unstale":"2023-03-03T07:43:37.379204+0000","last_undegraded":"2023-03-03T07:43:37.379204+0000","last_fullsized":"2023-03-03T07:43:37.379204+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:59:24.744163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":1,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378705+0000","last_change":"2023-03-03T07:43:36.383356+0000","last_active":"2023-03-03T07:43:37.378705+0000","last_peered":"2023-03-03T07:43:37.378705+0000","last_clean":"2023-03-03T07:43:37.378705+0000","last_became_active":"2023-03-03T07:43:36.381546+0000","last_became_peered":"2023-03-03T07:43:36.381546+0000","last_unstale":"2023-03-03T07:43:37.378705+0000","last_undegraded":"2023-03-03T07:43:37.378705+0000","last_fullsized":"2023-03-03T07:43:37.378705+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:06:50.266644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"15'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379105+0000","last_change":"2023-03-03T07:43:35.894711+0000","last_active":"2023-03-03T07:43:37.379105+0000","last_peered":"2023-03-03T07:43:37.379105+0000","last_clean":"2023-03-03T07:43:37.379105+0000","last_became_active":"2023-03-03T07:43:35.893970+0000","last_became_peered":"2023-03-03T07:43:35.893970+0000","last_unstale":"2023-03-03T07:43:37.379105+0000","last_undegraded":"2023-03-03T07:43:37.379105+0000","last_fullsized":"2023-03-03T07:43:37.379105+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:17:16.461687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":1,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379601+0000","last_change":"2023-03-03T07:43:36.389431+0000","last_active":"2023-03-03T07:43:37.379601+0000","last_peered":"2023-03-03T07:43:37.379601+0000","last_clean":"2023-03-03T07:43:37.379601+0000","last_became_active":"2023-03-03T07:43:36.388088+0000","last_became_peered":"2023-03-03T07:43:36.388088+0000","last_unstale":"2023-03-03T07:43:37.379601+0000","last_undegraded":"2023-03-03T07:43:37.379601+0000","last_fullsized":"2023-03-03T07:43:37.379601+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:38:06.090984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381157+0000","last_change":"2023-03-03T07:43:35.896502+0000","last_active":"2023-03-03T07:43:37.381157+0000","last_peered":"2023-03-03T07:43:37.381157+0000","last_clean":"2023-03-03T07:43:37.381157+0000","last_became_active":"2023-03-03T07:43:35.896259+0000","last_became_peered":"2023-03-03T07:43:35.896259+0000","last_unstale":"2023-03-03T07:43:37.381157+0000","last_undegraded":"2023-03-03T07:43:37.381157+0000","last_fullsized":"2023-03-03T07:43:37.381157+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:16:57.833751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377310+0000","last_change":"2023-03-03T07:43:36.385037+0000","last_active":"2023-03-03T07:43:37.377310+0000","last_peered":"2023-03-03T07:43:37.377310+0000","last_clean":"2023-03-03T07:43:37.377310+0000","last_became_active":"2023-03-03T07:43:36.383754+0000","last_became_peered":"2023-03-03T07:43:36.383754+0000","last_unstale":"2023-03-03T07:43:37.377310+0000","last_undegraded":"2023-03-03T07:43:37.377310+0000","last_fullsized":"2023-03-03T07:43:37.377310+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:23:35.231949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381694+0000","last_change":"2023-03-03T07:43:35.895981+0000","last_active":"2023-03-03T07:43:37.381694+0000","last_peered":"2023-03-03T07:43:37.381694+0000","last_clean":"2023-03-03T07:43:37.381694+0000","last_became_active":"2023-03-03T07:43:35.895386+0000","last_became_peered":"2023-03-03T07:43:35.895386+0000","last_unstale":"2023-03-03T07:43:37.381694+0000","last_undegraded":"2023-03-03T07:43:37.381694+0000","last_fullsized":"2023-03-03T07:43:37.381694+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:55:52.173973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":1},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":32,"acting":32,"num_store_stats":1},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":8,"acting":8,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":1,"acting":1,"num_store_stats":1}],"osd_stats":[{"osd":0,"up_from":6,"seq":25769803781,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":1048576,"kb_used":9260,"kb_used_data":740,"kb_used_omap":0,"kb_used_meta":8512,"kb_avail":1039316,"statfs":{"total":1073741824,"available":1064259584,"internally_reserved":0,"allocated":757760,"data_stored":627806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8716288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-03T07:43:41.322 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-03-03T07:43:41.322 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-03-03T07:43:41.322 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-03-03T07:43:41.323 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-03-03T07:43:41.323 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-03-03T07:43:41.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.560+0000 7f8f9359e700 1 Processor -- start 2023-03-03T07:43:41.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.560+0000 7f8f9359e700 1 -- start start 2023-03-03T07:43:41.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.560+0000 7f8f9359e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8f94095060 0x7f8f94095430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:41.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.560+0000 7f8f9359e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f94095e20 con 0x7f8f9408b090 2023-03-03T07:43:41.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.560+0000 7f8f9359e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f94095970 con 0x7f8f94095060 2023-03-03T07:43:41.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.564+0000 7f8f89d9b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f8f9408b090 0x7f8f9408b4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56806/0 (socket says 172.21.15.57:56806) 2023-03-03T07:43:41.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.564+0000 7f8f89d9b700 1 -- 172.21.15.57:0/1499842135 learned_addr learned my addr 172.21.15.57:0/1499842135 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:43:41.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.564+0000 7f8f9259c700 1 --2- 172.21.15.57:0/1499842135 >> v2:172.21.15.57:3300/0 conn(0x7f8f94095060 0x7f8f94095430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:41.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.564+0000 7f8f91d9b700 1 -- 172.21.15.57:0/1499842135 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2280204266 0 0) 0x7f8f94095e20 con 0x7f8f9408b090 2023-03-03T07:43:41.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.564+0000 7f8f91d9b700 1 -- 172.21.15.57:0/1499842135 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f740035d0 con 0x7f8f9408b090 2023-03-03T07:43:41.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.564+0000 7f8f9259c700 1 -- 172.21.15.57:0/1499842135 >> v1:172.21.15.57:6789/0 conn(0x7f8f9408b090 legacy=0x7f8f9408b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:41.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.564+0000 7f8f9259c700 1 -- 172.21.15.57:0/1499842135 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f9408c2d0 con 0x7f8f94095060 2023-03-03T07:43:41.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.564+0000 7f8f9259c700 1 --2- 172.21.15.57:0/1499842135 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f94095060 0x7f8f94095430 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8f840097d0 tx=0x7f8f84009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f73afa82a541010 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:41.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.564+0000 7f8f91d9b700 1 -- 172.21.15.57:0/1499842135 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8f84004160 con 0x7f8f94095060 2023-03-03T07:43:41.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.564+0000 7f8f91d9b700 1 -- 172.21.15.57:0/1499842135 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f840042c0 con 0x7f8f94095060 2023-03-03T07:43:41.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.564+0000 7f8f91d9b700 1 -- 172.21.15.57:0/1499842135 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8f84004580 con 0x7f8f94095060 2023-03-03T07:43:41.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.568+0000 7f8f9359e700 1 -- 172.21.15.57:0/1499842135 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f94095060 msgr2=0x7f8f94095430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:41.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.568+0000 7f8f9359e700 1 --2- 172.21.15.57:0/1499842135 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f94095060 0x7f8f94095430 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8f840097d0 tx=0x7f8f84009ae0 comp rx=0 tx=0).stop 2023-03-03T07:43:41.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.568+0000 7f8f9359e700 1 -- 172.21.15.57:0/1499842135 shutdown_connections 2023-03-03T07:43:41.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.568+0000 7f8f9359e700 1 --2- 172.21.15.57:0/1499842135 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f94095060 0x7f8f94095430 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:41.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.568+0000 7f8f9359e700 1 -- 172.21.15.57:0/1499842135 >> 172.21.15.57:0/1499842135 conn(0x7f8f9406c840 msgr2=0x7f8f9406ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:41.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.568+0000 7f8f9359e700 1 -- 172.21.15.57:0/1499842135 shutdown_connections 2023-03-03T07:43:41.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.568+0000 7f8f9359e700 1 -- 172.21.15.57:0/1499842135 wait complete. 2023-03-03T07:43:41.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.568+0000 7f8f9359e700 1 Processor -- start 2023-03-03T07:43:41.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.572+0000 7f8f9359e700 1 -- start start 2023-03-03T07:43:41.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.572+0000 7f8f9359e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f9408b090 0x7f8f941b9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:41.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.572+0000 7f8f9359e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f94121fb0 con 0x7f8f9408b090 2023-03-03T07:43:41.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.572+0000 7f8f9259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f9408b090 0x7f8f941b9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:41.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.572+0000 7f8f9259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f9408b090 0x7f8f941b9e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35674/0 (socket says 172.21.15.57:35674) 2023-03-03T07:43:41.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.572+0000 7f8f9259c700 1 -- 172.21.15.57:0/316004116 learned_addr learned my addr 172.21.15.57:0/316004116 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:41.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.572+0000 7f8f9259c700 1 -- 172.21.15.57:0/316004116 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f840094b0 con 0x7f8f9408b090 2023-03-03T07:43:41.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.572+0000 7f8f9259c700 1 --2- 172.21.15.57:0/316004116 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f9408b090 0x7f8f941b9e00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8f84009b20 tx=0x7f8f84004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:41.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.572+0000 7f8f8b7fe700 1 -- 172.21.15.57:0/316004116 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8f84006ea0 con 0x7f8f9408b090 2023-03-03T07:43:41.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.572+0000 7f8f8b7fe700 1 -- 172.21.15.57:0/316004116 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f8401f070 con 0x7f8f9408b090 2023-03-03T07:43:41.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.572+0000 7f8f8b7fe700 1 -- 172.21.15.57:0/316004116 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8f84003e60 con 0x7f8f9408b090 2023-03-03T07:43:41.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.572+0000 7f8f9359e700 1 -- 172.21.15.57:0/316004116 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f9408bbf0 con 0x7f8f9408b090 2023-03-03T07:43:41.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.572+0000 7f8f9359e700 1 -- 172.21.15.57:0/316004116 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f9408c5e0 con 0x7f8f9408b090 2023-03-03T07:43:41.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.576+0000 7f8f9359e700 1 -- 172.21.15.57:0/316004116 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f9408bd80 con 0x7f8f9408b090 2023-03-03T07:43:41.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.576+0000 7f8f8b7fe700 1 -- 172.21.15.57:0/316004116 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42205+0+0 (secure 0 0 0) 0x7f8f8402a020 con 0x7f8f9408b090 2023-03-03T07:43:41.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.576+0000 7f8f8b7fe700 1 --2- 172.21.15.57:0/316004116 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f8f78034830 0x7f8f78036ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:41.583 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.576+0000 7f8f8b7fe700 1 -- 172.21.15.57:0/316004116 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2928+0+0 (secure 0 0 0) 0x7f8f84047770 con 0x7f8f9408b090 2023-03-03T07:43:41.583 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.576+0000 7f8f89d9b700 1 --2- 172.21.15.57:0/316004116 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f8f78034830 0x7f8f78036ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:41.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.580+0000 7f8f89d9b700 1 --2- 172.21.15.57:0/316004116 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f8f78034830 0x7f8f78036ce0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c000f60 tx=0x7f8f7c0010a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:41.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.584+0000 7f8f8b7fe700 1 -- 172.21.15.57:0/316004116 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8f84019780 con 0x7f8f9408b090 2023-03-03T07:43:41.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.800+0000 7f8f9359e700 1 -- 172.21.15.57:0/316004116 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f8f940619b0 con 0x7f8f9408b090 2023-03-03T07:43:41.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.808+0000 7f8f8b7fe700 1 -- 172.21.15.57:0/316004116 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+81425 (secure 0 0 0) 0x7f8f84045e30 con 0x7f8f9408b090 2023-03-03T07:43:41.813 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-03T07:43:41.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.808+0000 7f8f9359e700 1 -- 172.21.15.57:0/316004116 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f8f78034830 msgr2=0x7f8f78036ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:41.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.808+0000 7f8f9359e700 1 --2- 172.21.15.57:0/316004116 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f8f78034830 0x7f8f78036ce0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c000f60 tx=0x7f8f7c0010a0 comp rx=0 tx=0).stop 2023-03-03T07:43:41.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.812+0000 7f8f9359e700 1 -- 172.21.15.57:0/316004116 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f9408b090 msgr2=0x7f8f941b9e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:41.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.812+0000 7f8f9359e700 1 --2- 172.21.15.57:0/316004116 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f9408b090 0x7f8f941b9e00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8f84009b20 tx=0x7f8f84004770 comp rx=0 tx=0).stop 2023-03-03T07:43:41.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.812+0000 7f8f9359e700 1 -- 172.21.15.57:0/316004116 shutdown_connections 2023-03-03T07:43:41.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.812+0000 7f8f9359e700 1 --2- 172.21.15.57:0/316004116 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f8f78034830 0x7f8f78036ce0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:41.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.812+0000 7f8f9359e700 1 --2- 172.21.15.57:0/316004116 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f9408b090 0x7f8f941b9e00 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:41.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.812+0000 7f8f9359e700 1 -- 172.21.15.57:0/316004116 >> 172.21.15.57:0/316004116 conn(0x7f8f9406c840 msgr2=0x7f8f94092d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:41.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.812+0000 7f8f9359e700 1 -- 172.21.15.57:0/316004116 shutdown_connections 2023-03-03T07:43:41.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:41.812+0000 7f8f9359e700 1 -- 172.21.15.57:0/316004116 wait complete. 2023-03-03T07:43:41.849 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":5,"active_gid":4099,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":28565},{"type":"v1","addr":"172.21.15.57:6809","nonce":28565}]},"active_addr":"172.21.15.57:6809/28565","active_change":"2023-03-03T07:43:20.734827+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.57:0","nonce":2836547662}]},{"addrvec":[{"type":"v2","addr":"172.21.15.57:0","nonce":949991734}]},{"addrvec":[{"type":"v2","addr":"172.21.15.57:0","nonce":2148032790}]},{"addrvec":[{"type":"v2","addr":"172.21.15.57:0","nonce":2945796659}]}]} 2023-03-03T07:43:41.851 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-03-03T07:43:41.852 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-03-03T07:43:41.852 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T07:43:42.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.052+0000 7f0a155f9700 1 Processor -- start 2023-03-03T07:43:42.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.052+0000 7f0a155f9700 1 -- start start 2023-03-03T07:43:42.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.052+0000 7f0a155f9700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0a10126db0 0x7f0a10127180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:42.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.056+0000 7f0a155f9700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a10071b40 con 0x7f0a1006f2e0 2023-03-03T07:43:42.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.056+0000 7f0a155f9700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a10070dc0 con 0x7f0a10126db0 2023-03-03T07:43:42.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.056+0000 7f0a0e7fc700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f0a1006f2e0 0x7f0a1006f760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56822/0 (socket says 172.21.15.57:56822) 2023-03-03T07:43:42.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.056+0000 7f0a0e7fc700 1 -- 172.21.15.57:0/3965598523 learned_addr learned my addr 172.21.15.57:0/3965598523 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:43:42.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.056+0000 7f0a0effd700 1 --2- 172.21.15.57:0/3965598523 >> v2:172.21.15.57:3300/0 conn(0x7f0a10126db0 0x7f0a10127180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:42.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.056+0000 7f0a0dffb700 1 -- 172.21.15.57:0/3965598523 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2680007879 0 0) 0x7f0a10071b40 con 0x7f0a1006f2e0 2023-03-03T07:43:42.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.056+0000 7f0a0dffb700 1 -- 172.21.15.57:0/3965598523 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09f80035d0 con 0x7f0a1006f2e0 2023-03-03T07:43:42.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.056+0000 7f0a0effd700 1 -- 172.21.15.57:0/3965598523 >> v1:172.21.15.57:6789/0 conn(0x7f0a1006f2e0 legacy=0x7f0a1006f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:42.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.056+0000 7f0a0effd700 1 -- 172.21.15.57:0/3965598523 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a10070500 con 0x7f0a10126db0 2023-03-03T07:43:42.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.056+0000 7f0a0effd700 1 --2- 172.21.15.57:0/3965598523 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a10126db0 0x7f0a10127180 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0a00009d90 tx=0x7f0a0000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ce7109db84c1762 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:42.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.056+0000 7f0a0dffb700 1 -- 172.21.15.57:0/3965598523 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0a0000e070 con 0x7f0a10126db0 2023-03-03T07:43:42.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.056+0000 7f0a0dffb700 1 -- 172.21.15.57:0/3965598523 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a0000bbd0 con 0x7f0a10126db0 2023-03-03T07:43:42.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.056+0000 7f0a0dffb700 1 -- 172.21.15.57:0/3965598523 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0a00003a40 con 0x7f0a10126db0 2023-03-03T07:43:42.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.060+0000 7f0a155f9700 1 -- 172.21.15.57:0/3965598523 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a10126db0 msgr2=0x7f0a10127180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:42.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.060+0000 7f0a155f9700 1 --2- 172.21.15.57:0/3965598523 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a10126db0 0x7f0a10127180 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0a00009d90 tx=0x7f0a0000b330 comp rx=0 tx=0).stop 2023-03-03T07:43:42.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.060+0000 7f0a155f9700 1 -- 172.21.15.57:0/3965598523 shutdown_connections 2023-03-03T07:43:42.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.060+0000 7f0a155f9700 1 --2- 172.21.15.57:0/3965598523 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a10126db0 0x7f0a10127180 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:42.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.060+0000 7f0a155f9700 1 -- 172.21.15.57:0/3965598523 >> 172.21.15.57:0/3965598523 conn(0x7f0a1006a0e0 msgr2=0x7f0a1006a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:42.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.060+0000 7f0a155f9700 1 -- 172.21.15.57:0/3965598523 shutdown_connections 2023-03-03T07:43:42.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.060+0000 7f0a155f9700 1 -- 172.21.15.57:0/3965598523 wait complete. 2023-03-03T07:43:42.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.060+0000 7f0a155f9700 1 Processor -- start 2023-03-03T07:43:42.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.060+0000 7f0a155f9700 1 -- start start 2023-03-03T07:43:42.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.064+0000 7f0a155f9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a1006f2e0 0x7f0a1011fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:42.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.064+0000 7f0a155f9700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a10121e00 con 0x7f0a1006f2e0 2023-03-03T07:43:42.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.064+0000 7f0a0effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a1006f2e0 0x7f0a1011fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:42.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.064+0000 7f0a0effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a1006f2e0 0x7f0a1011fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35684/0 (socket says 172.21.15.57:35684) 2023-03-03T07:43:42.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.064+0000 7f0a0effd700 1 -- 172.21.15.57:0/3691425888 learned_addr learned my addr 172.21.15.57:0/3691425888 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:42.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.064+0000 7f0a0effd700 1 -- 172.21.15.57:0/3691425888 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a00009a70 con 0x7f0a1006f2e0 2023-03-03T07:43:42.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.064+0000 7f0a0effd700 1 --2- 172.21.15.57:0/3691425888 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a1006f2e0 0x7f0a1011fae0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0a0000b370 tx=0x7f0a00004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:42.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.064+0000 7f09f77fe700 1 -- 172.21.15.57:0/3691425888 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0a00012430 con 0x7f0a1006f2e0 2023-03-03T07:43:42.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.064+0000 7f09f77fe700 1 -- 172.21.15.57:0/3691425888 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a000125b0 con 0x7f0a1006f2e0 2023-03-03T07:43:42.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.064+0000 7f09f77fe700 1 -- 172.21.15.57:0/3691425888 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0a00012890 con 0x7f0a1006f2e0 2023-03-03T07:43:42.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.064+0000 7f0a155f9700 1 -- 172.21.15.57:0/3691425888 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a1006fe70 con 0x7f0a1006f2e0 2023-03-03T07:43:42.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.064+0000 7f0a155f9700 1 -- 172.21.15.57:0/3691425888 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a10071490 con 0x7f0a1006f2e0 2023-03-03T07:43:42.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.068+0000 7f09f77fe700 1 -- 172.21.15.57:0/3691425888 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42205+0+0 (secure 0 0 0) 0x7f0a000129f0 con 0x7f0a1006f2e0 2023-03-03T07:43:42.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.068+0000 7f0a155f9700 1 -- 172.21.15.57:0/3691425888 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a10070000 con 0x7f0a1006f2e0 2023-03-03T07:43:42.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.068+0000 7f09f77fe700 1 --2- 172.21.15.57:0/3691425888 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f09fc034830 0x7f09fc036ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:42.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.068+0000 7f09f77fe700 1 -- 172.21.15.57:0/3691425888 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2928+0+0 (secure 0 0 0) 0x7f0a000488a0 con 0x7f0a1006f2e0 2023-03-03T07:43:42.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.068+0000 7f0a0e7fc700 1 --2- 172.21.15.57:0/3691425888 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f09fc034830 0x7f09fc036ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:42.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.072+0000 7f0a0e7fc700 1 --2- 172.21.15.57:0/3691425888 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f09fc034830 0x7f09fc036ce0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0a040016d0 tx=0x7f0a04007a20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:42.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.076+0000 7f09f77fe700 1 -- 172.21.15.57:0/3691425888 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f0a00012c80 con 0x7f0a1006f2e0 2023-03-03T07:43:42.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.256+0000 7f0a155f9700 1 -- 172.21.15.57:0/3691425888 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0a10121f50 con 0x7f0a1006f2e0 2023-03-03T07:43:42.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.260+0000 7f09f77fe700 1 -- 172.21.15.57:0/3691425888 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+9544 (secure 0 0 0) 0x7f0a0002db90 con 0x7f0a1006f2e0 2023-03-03T07:43:42.265 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-03T07:43:42.265 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":16,"fsid":"5022d617-ad40-4ad9-8d5b-120958296d9c","created":"2023-03-03T07:43:13.256676+0000","modified":"2023-03-03T07:43:37.358119+0000","last_up_change":"2023-03-03T07:43:22.721740+0000","last_in_change":"2023-03-03T07:43:13.786190+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":1,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-03T07:43:22.864508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":1,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"9","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":1,"score_stable":1,"optimal_score":1,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-03T07:43:28.091327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":1,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1,"score_stable":1,"optimal_score":1,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-03T07:43:33.981804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":1,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1,"score_stable":1,"optimal_score":1,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-03T07:43:35.408700+0000","flags":1,"flags_names":"hashpspool","type":1,"size":1,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1,"score_stable":1,"optimal_score":1,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d83f7ba7-9d9d-4309-95b9-2b8ad96f2f8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":6,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":28687},{"type":"v1","addr":"172.21.15.57:6801","nonce":28687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":28687},{"type":"v1","addr":"172.21.15.57:6803","nonce":28687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":28687},{"type":"v1","addr":"172.21.15.57:6807","nonce":28687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":28687},{"type":"v1","addr":"172.21.15.57:6805","nonce":28687}]},"public_addr":"172.21.15.57:6801/28687","cluster_addr":"172.21.15.57:6803/28687","heartbeat_back_addr":"172.21.15.57:6807/28687","heartbeat_front_addr":"172.21.15.57:6805/28687","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T07:43:19.859898+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T07:43:42.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.260+0000 7f0a155f9700 1 -- 172.21.15.57:0/3691425888 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f09fc034830 msgr2=0x7f09fc036ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:42.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.260+0000 7f0a155f9700 1 --2- 172.21.15.57:0/3691425888 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f09fc034830 0x7f09fc036ce0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0a040016d0 tx=0x7f0a04007a20 comp rx=0 tx=0).stop 2023-03-03T07:43:42.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.260+0000 7f0a155f9700 1 -- 172.21.15.57:0/3691425888 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a1006f2e0 msgr2=0x7f0a1011fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:42.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.260+0000 7f0a155f9700 1 --2- 172.21.15.57:0/3691425888 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a1006f2e0 0x7f0a1011fae0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0a0000b370 tx=0x7f0a00004af0 comp rx=0 tx=0).stop 2023-03-03T07:43:42.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.264+0000 7f0a155f9700 1 -- 172.21.15.57:0/3691425888 shutdown_connections 2023-03-03T07:43:42.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.264+0000 7f0a155f9700 1 --2- 172.21.15.57:0/3691425888 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f09fc034830 0x7f09fc036ce0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:42.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.264+0000 7f0a155f9700 1 --2- 172.21.15.57:0/3691425888 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a1006f2e0 0x7f0a1011fae0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:42.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.264+0000 7f0a155f9700 1 -- 172.21.15.57:0/3691425888 >> 172.21.15.57:0/3691425888 conn(0x7f0a1006a0e0 msgr2=0x7f0a10090580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:42.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.264+0000 7f0a155f9700 1 -- 172.21.15.57:0/3691425888 shutdown_connections 2023-03-03T07:43:42.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.264+0000 7f0a155f9700 1 -- 172.21.15.57:0/3691425888 wait complete. 2023-03-03T07:43:42.301 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-03-03T07:43:42.302 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T07:43:42.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.500+0000 7fa1122dc700 1 Processor -- start 2023-03-03T07:43:42.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.500+0000 7fa1122dc700 1 -- start start 2023-03-03T07:43:42.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.500+0000 7fa1122dc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa10c08aa60 0x7fa10c12d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:42.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.500+0000 7fa1122dc700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa10c095b20 con 0x7fa10c089f80 2023-03-03T07:43:42.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.500+0000 7fa1122dc700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa10c08b1e0 con 0x7fa10c08aa60 2023-03-03T07:43:42.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.504+0000 7fa110ad9700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa10c08aa60 0x7fa10c12d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:42.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.504+0000 7fa110ad9700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa10c08aa60 0x7fa10c12d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35696/0 (socket says 172.21.15.57:35696) 2023-03-03T07:43:42.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.504+0000 7fa110ad9700 1 -- 172.21.15.57:0/3101759331 learned_addr learned my addr 172.21.15.57:0/3101759331 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:42.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.504+0000 7fa110ad9700 1 -- 172.21.15.57:0/3101759331 >> v1:172.21.15.57:6789/0 conn(0x7fa10c089f80 legacy=0x7fa10c08a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:42.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.504+0000 7fa110ad9700 1 -- 172.21.15.57:0/3101759331 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa10c08b4f0 con 0x7fa10c08aa60 2023-03-03T07:43:42.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.504+0000 7fa110ad9700 1 --2- 172.21.15.57:0/3101759331 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa10c08aa60 0x7fa10c12d200 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc009890 tx=0x7fa0fc009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcbf8a93134b5e88 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:42.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.504+0000 7fa103fff700 1 -- 172.21.15.57:0/3101759331 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa0fc004160 con 0x7fa10c08aa60 2023-03-03T07:43:42.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.504+0000 7fa103fff700 1 -- 172.21.15.57:0/3101759331 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0fc0042c0 con 0x7fa10c08aa60 2023-03-03T07:43:42.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.504+0000 7fa103fff700 1 -- 172.21.15.57:0/3101759331 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa0fc004580 con 0x7fa10c08aa60 2023-03-03T07:43:42.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.504+0000 7fa1122dc700 1 -- 172.21.15.57:0/3101759331 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa10c08aa60 msgr2=0x7fa10c12d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:42.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.504+0000 7fa1122dc700 1 --2- 172.21.15.57:0/3101759331 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa10c08aa60 0x7fa10c12d200 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc009890 tx=0x7fa0fc009ba0 comp rx=0 tx=0).stop 2023-03-03T07:43:42.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.504+0000 7fa1122dc700 1 -- 172.21.15.57:0/3101759331 shutdown_connections 2023-03-03T07:43:42.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.504+0000 7fa1122dc700 1 --2- 172.21.15.57:0/3101759331 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa10c08aa60 0x7fa10c12d200 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:42.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.504+0000 7fa1122dc700 1 -- 172.21.15.57:0/3101759331 >> 172.21.15.57:0/3101759331 conn(0x7fa10c06c840 msgr2=0x7fa10c06ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:42.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.508+0000 7fa1122dc700 1 -- 172.21.15.57:0/3101759331 shutdown_connections 2023-03-03T07:43:42.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.508+0000 7fa1122dc700 1 -- 172.21.15.57:0/3101759331 wait complete. 2023-03-03T07:43:42.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.508+0000 7fa1122dc700 1 Processor -- start 2023-03-03T07:43:42.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.512+0000 7fa1122dc700 1 -- start start 2023-03-03T07:43:42.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.512+0000 7fa1122dc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa10c089f80 0x7fa10c11d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:42.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.512+0000 7fa1122dc700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa10c11f740 con 0x7fa10c089f80 2023-03-03T07:43:42.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.512+0000 7fa1112da700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa10c089f80 0x7fa10c11d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:42.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.512+0000 7fa1112da700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa10c089f80 0x7fa10c11d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35698/0 (socket says 172.21.15.57:35698) 2023-03-03T07:43:42.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.512+0000 7fa1112da700 1 -- 172.21.15.57:0/773195415 learned_addr learned my addr 172.21.15.57:0/773195415 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:42.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.512+0000 7fa1112da700 1 -- 172.21.15.57:0/773195415 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0fc009570 con 0x7fa10c089f80 2023-03-03T07:43:42.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.512+0000 7fa1112da700 1 --2- 172.21.15.57:0/773195415 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa10c089f80 0x7fa10c11d4c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa10800c480 tx=0x7fa10800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:42.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.516+0000 7fa101ffb700 1 -- 172.21.15.57:0/773195415 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa108005150 con 0x7fa10c089f80 2023-03-03T07:43:42.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.516+0000 7fa1122dc700 1 -- 172.21.15.57:0/773195415 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa10c12d8d0 con 0x7fa10c089f80 2023-03-03T07:43:42.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.516+0000 7fa101ffb700 1 -- 172.21.15.57:0/773195415 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1080052b0 con 0x7fa10c089f80 2023-03-03T07:43:42.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.516+0000 7fa101ffb700 1 -- 172.21.15.57:0/773195415 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa108005590 con 0x7fa10c089f80 2023-03-03T07:43:42.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.516+0000 7fa1122dc700 1 -- 172.21.15.57:0/773195415 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa10c12d740 con 0x7fa10c089f80 2023-03-03T07:43:42.522 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.516+0000 7fa1122dc700 1 -- 172.21.15.57:0/773195415 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa10c12da60 con 0x7fa10c089f80 2023-03-03T07:43:42.522 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.516+0000 7fa101ffb700 1 -- 172.21.15.57:0/773195415 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42205+0+0 (secure 0 0 0) 0x7fa108010050 con 0x7fa10c089f80 2023-03-03T07:43:42.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.520+0000 7fa101ffb700 1 --2- 172.21.15.57:0/773195415 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fa0f00347f0 0x7fa0f0036ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:42.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.520+0000 7fa101ffb700 1 -- 172.21.15.57:0/773195415 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2928+0+0 (secure 0 0 0) 0x7fa108045390 con 0x7fa10c089f80 2023-03-03T07:43:42.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.520+0000 7fa110ad9700 1 --2- 172.21.15.57:0/773195415 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fa0f00347f0 0x7fa0f0036ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:42.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.520+0000 7fa110ad9700 1 --2- 172.21.15.57:0/773195415 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fa0f00347f0 0x7fa0f0036ca0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc009fd0 tx=0x7fa0fc008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:42.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.524+0000 7fa101ffb700 1 -- 172.21.15.57:0/773195415 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa1080106f0 con 0x7fa10c089f80 2023-03-03T07:43:42.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.700+0000 7fa1122dc700 1 -- 172.21.15.57:0/773195415 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa10c128f30 con 0x7fa10c089f80 2023-03-03T07:43:42.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.700+0000 7fa101ffb700 1 -- 172.21.15.57:0/773195415 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+9544 (secure 0 0 0) 0x7fa10801a3a0 con 0x7fa10c089f80 2023-03-03T07:43:42.708 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-03T07:43:42.708 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":16,"fsid":"5022d617-ad40-4ad9-8d5b-120958296d9c","created":"2023-03-03T07:43:13.256676+0000","modified":"2023-03-03T07:43:37.358119+0000","last_up_change":"2023-03-03T07:43:22.721740+0000","last_in_change":"2023-03-03T07:43:13.786190+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":1,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-03T07:43:22.864508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":1,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"9","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":1,"score_stable":1,"optimal_score":1,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-03T07:43:28.091327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":1,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1,"score_stable":1,"optimal_score":1,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-03T07:43:33.981804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":1,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1,"score_stable":1,"optimal_score":1,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-03T07:43:35.408700+0000","flags":1,"flags_names":"hashpspool","type":1,"size":1,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1,"score_stable":1,"optimal_score":1,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d83f7ba7-9d9d-4309-95b9-2b8ad96f2f8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":6,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":28687},{"type":"v1","addr":"172.21.15.57:6801","nonce":28687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":28687},{"type":"v1","addr":"172.21.15.57:6803","nonce":28687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":28687},{"type":"v1","addr":"172.21.15.57:6807","nonce":28687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":28687},{"type":"v1","addr":"172.21.15.57:6805","nonce":28687}]},"public_addr":"172.21.15.57:6801/28687","cluster_addr":"172.21.15.57:6803/28687","heartbeat_back_addr":"172.21.15.57:6807/28687","heartbeat_front_addr":"172.21.15.57:6805/28687","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T07:43:19.859898+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T07:43:42.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.708+0000 7fa1122dc700 1 -- 172.21.15.57:0/773195415 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fa0f00347f0 msgr2=0x7fa0f0036ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:42.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.708+0000 7fa1122dc700 1 --2- 172.21.15.57:0/773195415 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fa0f00347f0 0x7fa0f0036ca0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc009fd0 tx=0x7fa0fc008030 comp rx=0 tx=0).stop 2023-03-03T07:43:42.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.708+0000 7fa1122dc700 1 -- 172.21.15.57:0/773195415 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa10c089f80 msgr2=0x7fa10c11d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:42.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.708+0000 7fa1122dc700 1 --2- 172.21.15.57:0/773195415 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa10c089f80 0x7fa10c11d4c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa10800c480 tx=0x7fa10800c840 comp rx=0 tx=0).stop 2023-03-03T07:43:42.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.708+0000 7fa1122dc700 1 -- 172.21.15.57:0/773195415 shutdown_connections 2023-03-03T07:43:42.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.708+0000 7fa1122dc700 1 --2- 172.21.15.57:0/773195415 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fa0f00347f0 0x7fa0f0036ca0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:42.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.708+0000 7fa1122dc700 1 --2- 172.21.15.57:0/773195415 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa10c089f80 0x7fa10c11d4c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:42.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.708+0000 7fa1122dc700 1 -- 172.21.15.57:0/773195415 >> 172.21.15.57:0/773195415 conn(0x7fa10c06c840 msgr2=0x7fa10c129560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:42.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.708+0000 7fa1122dc700 1 -- 172.21.15.57:0/773195415 shutdown_connections 2023-03-03T07:43:42.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.708+0000 7fa1122dc700 1 -- 172.21.15.57:0/773195415 wait complete. 2023-03-03T07:43:42.747 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-03-03T07:43:42.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.948+0000 7ff59a420700 1 Processor -- start 2023-03-03T07:43:42.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.948+0000 7ff59a420700 1 -- start start 2023-03-03T07:43:42.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.952+0000 7ff59a420700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff5941289f0 0x7ff59412add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:42.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.952+0000 7ff59a420700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff59408d7f0 con 0x7ff594125c80 2023-03-03T07:43:42.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.952+0000 7ff59a420700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5940711a0 con 0x7ff5941289f0 2023-03-03T07:43:42.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.952+0000 7ff59941e700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ff594125c80 0x7ff594126050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56842/0 (socket says 172.21.15.57:56842) 2023-03-03T07:43:42.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.952+0000 7ff59941e700 1 -- 172.21.15.57:0/3194772640 learned_addr learned my addr 172.21.15.57:0/3194772640 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:43:42.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.952+0000 7ff598c1d700 1 --2- 172.21.15.57:0/3194772640 >> v2:172.21.15.57:3300/0 conn(0x7ff5941289f0 0x7ff59412add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:42.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.952+0000 7ff58bfff700 1 -- 172.21.15.57:0/3194772640 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2504860230 0 0) 0x7ff59408d7f0 con 0x7ff594125c80 2023-03-03T07:43:42.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.952+0000 7ff58bfff700 1 -- 172.21.15.57:0/3194772640 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5800035d0 con 0x7ff594125c80 2023-03-03T07:43:42.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.952+0000 7ff598c1d700 1 -- 172.21.15.57:0/3194772640 >> v1:172.21.15.57:6789/0 conn(0x7ff594125c80 legacy=0x7ff594126050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:42.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.952+0000 7ff598c1d700 1 -- 172.21.15.57:0/3194772640 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5941256a0 con 0x7ff5941289f0 2023-03-03T07:43:42.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.952+0000 7ff598c1d700 1 --2- 172.21.15.57:0/3194772640 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5941289f0 0x7ff59412add0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff5840097d0 tx=0x7ff584009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e54030ee1da4228 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:42.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.952+0000 7ff58bfff700 1 -- 172.21.15.57:0/3194772640 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff584004160 con 0x7ff5941289f0 2023-03-03T07:43:42.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.952+0000 7ff58bfff700 1 -- 172.21.15.57:0/3194772640 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5840042c0 con 0x7ff5941289f0 2023-03-03T07:43:42.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.952+0000 7ff58bfff700 1 -- 172.21.15.57:0/3194772640 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5840045a0 con 0x7ff5941289f0 2023-03-03T07:43:42.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.956+0000 7ff59a420700 1 -- 172.21.15.57:0/3194772640 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5941289f0 msgr2=0x7ff59412add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:42.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.956+0000 7ff59a420700 1 --2- 172.21.15.57:0/3194772640 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5941289f0 0x7ff59412add0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff5840097d0 tx=0x7ff584009ae0 comp rx=0 tx=0).stop 2023-03-03T07:43:42.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.956+0000 7ff59a420700 1 -- 172.21.15.57:0/3194772640 shutdown_connections 2023-03-03T07:43:42.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.956+0000 7ff59a420700 1 --2- 172.21.15.57:0/3194772640 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5941289f0 0x7ff59412add0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:42.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.956+0000 7ff59a420700 1 -- 172.21.15.57:0/3194772640 >> 172.21.15.57:0/3194772640 conn(0x7ff59406c840 msgr2=0x7ff59406ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:42.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.956+0000 7ff59a420700 1 -- 172.21.15.57:0/3194772640 shutdown_connections 2023-03-03T07:43:42.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.956+0000 7ff59a420700 1 -- 172.21.15.57:0/3194772640 wait complete. 2023-03-03T07:43:42.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.956+0000 7ff59a420700 1 Processor -- start 2023-03-03T07:43:42.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.960+0000 7ff59a420700 1 -- start start 2023-03-03T07:43:42.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.960+0000 7ff59a420700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff594125c80 0x7ff5941b9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:42.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.960+0000 7ff59a420700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff594095930 con 0x7ff594125c80 2023-03-03T07:43:42.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.960+0000 7ff59941e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff594125c80 0x7ff5941b9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:42.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.960+0000 7ff59941e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff594125c80 0x7ff5941b9da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35702/0 (socket says 172.21.15.57:35702) 2023-03-03T07:43:42.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.960+0000 7ff59941e700 1 -- 172.21.15.57:0/3646082879 learned_addr learned my addr 172.21.15.57:0/3646082879 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:42.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.960+0000 7ff59941e700 1 -- 172.21.15.57:0/3646082879 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5840094b0 con 0x7ff594125c80 2023-03-03T07:43:42.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.960+0000 7ff59941e700 1 --2- 172.21.15.57:0/3646082879 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff594125c80 0x7ff5941b9da0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff59000c680 tx=0x7ff59000ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:42.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.960+0000 7ff589ffb700 1 -- 172.21.15.57:0/3646082879 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff590005cc0 con 0x7ff594125c80 2023-03-03T07:43:42.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.960+0000 7ff589ffb700 1 -- 172.21.15.57:0/3646082879 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff590005e20 con 0x7ff594125c80 2023-03-03T07:43:42.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.960+0000 7ff59a420700 1 -- 172.21.15.57:0/3646082879 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff59412b4a0 con 0x7ff594125c80 2023-03-03T07:43:42.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.960+0000 7ff589ffb700 1 -- 172.21.15.57:0/3646082879 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff590007220 con 0x7ff594125c80 2023-03-03T07:43:42.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.960+0000 7ff59a420700 1 -- 172.21.15.57:0/3646082879 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff59412b310 con 0x7ff594125c80 2023-03-03T07:43:42.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.964+0000 7ff59a420700 1 -- 172.21.15.57:0/3646082879 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff59412b630 con 0x7ff594125c80 2023-03-03T07:43:42.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.964+0000 7ff589ffb700 1 -- 172.21.15.57:0/3646082879 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42205+0+0 (secure 0 0 0) 0x7ff590019030 con 0x7ff594125c80 2023-03-03T07:43:42.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.964+0000 7ff589ffb700 1 --2- 172.21.15.57:0/3646082879 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7ff578034840 0x7ff578036cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:42.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.964+0000 7ff589ffb700 1 -- 172.21.15.57:0/3646082879 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2928+0+0 (secure 0 0 0) 0x7ff590045570 con 0x7ff594125c80 2023-03-03T07:43:42.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.968+0000 7ff589ffb700 1 --2- 172.21.15.57:0/3646082879 >> [v2:172.21.15.57:6800/28687,v1:172.21.15.57:6801/28687] conn(0x7ff57803b760 0x7ff57803dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:42.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.968+0000 7ff589ffb700 1 -- 172.21.15.57:0/3646082879 --> [v2:172.21.15.57:6800/28687,v1:172.21.15.57:6801/28687] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff57803e2c0 con 0x7ff57803b760 2023-03-03T07:43:42.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.968+0000 7ff589ffb700 1 -- 172.21.15.57:0/3646082879 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff590047ba0 con 0x7ff594125c80 2023-03-03T07:43:42.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.968+0000 7ff598c1d700 1 --2- 172.21.15.57:0/3646082879 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7ff578034840 0x7ff578036cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:42.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.968+0000 7ff599c1f700 1 --2- 172.21.15.57:0/3646082879 >> [v2:172.21.15.57:6800/28687,v1:172.21.15.57:6801/28687] conn(0x7ff57803b760 0x7ff57803dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:42.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.968+0000 7ff598c1d700 1 --2- 172.21.15.57:0/3646082879 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7ff578034840 0x7ff578036cf0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff584006ee0 tx=0x7ff584008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:42.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.968+0000 7ff599c1f700 1 --2- 172.21.15.57:0/3646082879 >> [v2:172.21.15.57:6800/28687,v1:172.21.15.57:6801/28687] conn(0x7ff57803b760 0x7ff57803dbf0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:42.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.968+0000 7ff589ffb700 1 -- 172.21.15.57:0/3646082879 <== osd.0 v2:172.21.15.57:6800/28687 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ff57803e2c0 con 0x7ff57803b760 2023-03-03T07:43:42.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.988+0000 7ff59a420700 1 -- 172.21.15.57:0/3646082879 --> [v2:172.21.15.57:6800/28687,v1:172.21.15.57:6801/28687] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff5940619b0 con 0x7ff57803b760 2023-03-03T07:43:42.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.992+0000 7ff589ffb700 1 -- 172.21.15.57:0/3646082879 <== osd.0 v2:172.21.15.57:6800/28687 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff5940619b0 con 0x7ff57803b760 2023-03-03T07:43:42.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.992+0000 7ff59a420700 1 -- 172.21.15.57:0/3646082879 >> [v2:172.21.15.57:6800/28687,v1:172.21.15.57:6801/28687] conn(0x7ff57803b760 msgr2=0x7ff57803dbf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:42.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.992+0000 7ff59a420700 1 --2- 172.21.15.57:0/3646082879 >> [v2:172.21.15.57:6800/28687,v1:172.21.15.57:6801/28687] conn(0x7ff57803b760 0x7ff57803dbf0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:43.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.996+0000 7ff59a420700 1 -- 172.21.15.57:0/3646082879 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7ff578034840 msgr2=0x7ff578036cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:43.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.996+0000 7ff59a420700 1 --2- 172.21.15.57:0/3646082879 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7ff578034840 0x7ff578036cf0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff584006ee0 tx=0x7ff584008030 comp rx=0 tx=0).stop 2023-03-03T07:43:43.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.996+0000 7ff59a420700 1 -- 172.21.15.57:0/3646082879 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff594125c80 msgr2=0x7ff5941b9da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:43.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.996+0000 7ff59a420700 1 --2- 172.21.15.57:0/3646082879 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff594125c80 0x7ff5941b9da0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff59000c680 tx=0x7ff59000ca40 comp rx=0 tx=0).stop 2023-03-03T07:43:43.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.996+0000 7ff59a420700 1 -- 172.21.15.57:0/3646082879 shutdown_connections 2023-03-03T07:43:43.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.996+0000 7ff59a420700 1 --2- 172.21.15.57:0/3646082879 >> [v2:172.21.15.57:6800/28687,v1:172.21.15.57:6801/28687] conn(0x7ff57803b760 0x7ff57803dbf0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:43.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.996+0000 7ff59a420700 1 --2- 172.21.15.57:0/3646082879 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7ff578034840 0x7ff578036cf0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:43.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.996+0000 7ff59a420700 1 --2- 172.21.15.57:0/3646082879 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff594125c80 0x7ff5941b9da0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:43.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.996+0000 7ff59a420700 1 -- 172.21.15.57:0/3646082879 >> 172.21.15.57:0/3646082879 conn(0x7ff59406c840 msgr2=0x7ff59406cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:43.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.996+0000 7ff59a420700 1 -- 172.21.15.57:0/3646082879 shutdown_connections 2023-03-03T07:43:43.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:42.996+0000 7ff59a420700 1 -- 172.21.15.57:0/3646082879 wait complete. 2023-03-03T07:43:43.029 INFO:teuthology.orchestra.run.smithi057.stdout:25769803783 2023-03-03T07:43:43.030 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-03-03T07:43:43.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:43.236+0000 7fd74262d700 1 Processor -- start 2023-03-03T07:43:43.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:43.236+0000 7fd74262d700 1 -- start start 2023-03-03T07:43:43.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:43.236+0000 7fd74262d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd73c127fc0 0x7fd73c128390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:43.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:43.236+0000 7fd74262d700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd73c110800 con 0x7fd73c10f320 2023-03-03T07:43:43.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:43.236+0000 7fd74262d700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd73c1104f0 con 0x7fd73c127fc0 2023-03-03T07:43:43.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:43.240+0000 7fd740e2a700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fd73c10f320 0x7fd73c10f770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56858/0 (socket says 172.21.15.57:56858) 2023-03-03T07:43:43.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:43.240+0000 7fd740e2a700 1 -- 172.21.15.57:0/980713652 learned_addr learned my addr 172.21.15.57:0/980713652 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:43:43.245 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:43.240+0000 7fd74162b700 1 --2- 172.21.15.57:0/980713652 >> v2:172.21.15.57:3300/0 conn(0x7fd73c127fc0 0x7fd73c128390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:43.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:43.240+0000 7fd733fff700 1 -- 172.21.15.57:0/980713652 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3716251513 0 0) 0x7fd73c110800 con 0x7fd73c10f320 2023-03-03T07:43:43.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:43.240+0000 7fd733fff700 1 -- 172.21.15.57:0/980713652 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7280035d0 con 0x7fd73c10f320 2023-03-03T07:43:43.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:43.240+0000 7fd74162b700 1 -- 172.21.15.57:0/980713652 >> v1:172.21.15.57:6789/0 conn(0x7fd73c10f320 legacy=0x7fd73c10f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:43.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:43.240+0000 7fd74162b700 1 -- 172.21.15.57:0/980713652 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd73c06b7b0 con 0x7fd73c127fc0 2023-03-03T07:43:43.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:43.240+0000 7fd74162b700 1 --2- 172.21.15.57:0/980713652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd73c127fc0 0x7fd73c128390 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd7380097d0 tx=0x7fd738009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e279f112dd9fe14a server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:43.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:43.240+0000 7fd733fff700 1 -- 172.21.15.57:0/980713652 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd738004160 con 0x7fd73c127fc0 2023-03-03T07:43:43.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:43.240+0000 7fd733fff700 1 -- 172.21.15.57:0/980713652 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7380042c0 con 0x7fd73c127fc0 2023-03-03T07:43:43.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:43.240+0000 7fd733fff700 1 -- 172.21.15.57:0/980713652 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd7380045a0 con 0x7fd73c127fc0 2023-03-03T07:43:43.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:43.240+0000 7fd74262d700 1 -- 172.21.15.57:0/980713652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd73c127fc0 msgr2=0x7fd73c128390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:43.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:43.240+0000 7fd74262d700 1 --2- 172.21.15.57:0/980713652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd73c127fc0 0x7fd73c128390 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd7380097d0 tx=0x7fd738009ae0 comp rx=0 tx=0).stop 2023-03-03T07:43:43.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:43.240+0000 7fd74262d700 1 -- 172.21.15.57:0/980713652 shutdown_connections 2023-03-03T07:43:43.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:43.240+0000 7fd74262d700 1 --2- 172.21.15.57:0/980713652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd73c127fc0 0x7fd73c128390 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:43.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:43.240+0000 7fd74262d700 1 -- 172.21.15.57:0/980713652 >> 172.21.15.57:0/980713652 conn(0x7fd73c06e6f0 msgr2=0x7fd73c070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:43.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:43.244+0000 7fd74262d700 1 -- 172.21.15.57:0/980713652 shutdown_connections 2023-03-03T07:43:43.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:43.244+0000 7fd74262d700 1 -- 172.21.15.57:0/980713652 wait complete. 2023-03-03T07:43:43.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:43.244+0000 7fd74262d700 1 Processor -- start 2023-03-03T07:43:43.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:43.244+0000 7fd74262d700 1 -- start start 2023-03-03T07:43:43.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:43.244+0000 7fd74262d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd73c10f320 0x7fd73c11a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:43.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:43.244+0000 7fd74262d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c11bc70 con 0x7fd73c10f320 2023-03-03T07:43:43.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:43.248+0000 7fd74162b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd73c10f320 0x7fd73c11a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:43.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:43.248+0000 7fd74162b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd73c10f320 0x7fd73c11a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35724/0 (socket says 172.21.15.57:35724) 2023-03-03T07:43:43.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:43.248+0000 7fd74162b700 1 -- 172.21.15.57:0/477817448 learned_addr learned my addr 172.21.15.57:0/477817448 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:43.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:43.248+0000 7fd74162b700 1 -- 172.21.15.57:0/477817448 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7380094b0 con 0x7fd73c10f320 2023-03-03T07:43:43.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:43.248+0000 7fd74162b700 1 --2- 172.21.15.57:0/477817448 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd73c10f320 0x7fd73c11a490 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd7380090b0 tx=0x7fd738004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:43.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:43.248+0000 7fd731ffb700 1 -- 172.21.15.57:0/477817448 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd738003c80 con 0x7fd73c10f320 2023-03-03T07:43:43.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:43.248+0000 7fd731ffb700 1 -- 172.21.15.57:0/477817448 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd73801f070 con 0x7fd73c10f320 2023-03-03T07:43:43.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:43.248+0000 7fd74262d700 1 -- 172.21.15.57:0/477817448 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd73c110010 con 0x7fd73c10f320 2023-03-03T07:43:43.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:43.248+0000 7fd731ffb700 1 -- 172.21.15.57:0/477817448 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd738011630 con 0x7fd73c10f320 2023-03-03T07:43:43.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:43.248+0000 7fd74262d700 1 -- 172.21.15.57:0/477817448 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd73c10fe80 con 0x7fd73c10f320 2023-03-03T07:43:43.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:43.252+0000 7fd74262d700 1 -- 172.21.15.57:0/477817448 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd73c1101a0 con 0x7fd73c10f320 2023-03-03T07:43:43.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:43.252+0000 7fd731ffb700 1 -- 172.21.15.57:0/477817448 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42205+0+0 (secure 0 0 0) 0x7fd73802a020 con 0x7fd73c10f320 2023-03-03T07:43:43.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:43.252+0000 7fd731ffb700 1 --2- 172.21.15.57:0/477817448 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fd720034830 0x7fd720036ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:43.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:43.252+0000 7fd731ffb700 1 -- 172.21.15.57:0/477817448 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2928+0+0 (secure 0 0 0) 0x7fd7380478c0 con 0x7fd73c10f320 2023-03-03T07:43:43.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:43.252+0000 7fd740e2a700 1 --2- 172.21.15.57:0/477817448 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fd720034830 0x7fd720036ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:43.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:43.256+0000 7fd740e2a700 1 --2- 172.21.15.57:0/477817448 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fd720034830 0x7fd720036ce0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd72c0016d0 tx=0x7fd72c007a20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:43.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:43.260+0000 7fd731ffb700 1 -- 172.21.15.57:0/477817448 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd7380117e0 con 0x7fd73c10f320 2023-03-03T07:43:43.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:43.436+0000 7fd74262d700 1 -- 172.21.15.57:0/477817448 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd73c0619b0 con 0x7fd73c10f320 2023-03-03T07:43:43.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:43.440+0000 7fd731ffb700 1 -- 172.21.15.57:0/477817448 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd738023bc0 con 0x7fd73c10f320 2023-03-03T07:43:43.444 INFO:teuthology.orchestra.run.smithi057.stdout:25769803781 2023-03-03T07:43:43.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:43.440+0000 7fd74262d700 1 -- 172.21.15.57:0/477817448 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fd720034830 msgr2=0x7fd720036ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:43.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:43.440+0000 7fd74262d700 1 --2- 172.21.15.57:0/477817448 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fd720034830 0x7fd720036ce0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd72c0016d0 tx=0x7fd72c007a20 comp rx=0 tx=0).stop 2023-03-03T07:43:43.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:43.440+0000 7fd74262d700 1 -- 172.21.15.57:0/477817448 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd73c10f320 msgr2=0x7fd73c11a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:43.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:43.440+0000 7fd74262d700 1 --2- 172.21.15.57:0/477817448 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd73c10f320 0x7fd73c11a490 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd7380090b0 tx=0x7fd738004770 comp rx=0 tx=0).stop 2023-03-03T07:43:43.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:43.444+0000 7fd74262d700 1 -- 172.21.15.57:0/477817448 shutdown_connections 2023-03-03T07:43:43.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:43.444+0000 7fd74262d700 1 --2- 172.21.15.57:0/477817448 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fd720034830 0x7fd720036ce0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:43.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:43.444+0000 7fd74262d700 1 --2- 172.21.15.57:0/477817448 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd73c10f320 0x7fd73c11a490 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:43.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:43.444+0000 7fd74262d700 1 -- 172.21.15.57:0/477817448 >> 172.21.15.57:0/477817448 conn(0x7fd73c06e6f0 msgr2=0x7fd73c12aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:43.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:43.444+0000 7fd74262d700 1 -- 172.21.15.57:0/477817448 shutdown_connections 2023-03-03T07:43:43.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:43.444+0000 7fd74262d700 1 -- 172.21.15.57:0/477817448 wait complete. 2023-03-03T07:43:43.480 INFO:tasks.ceph.ceph_manager.ceph:need seq 25769803783 got 25769803781 for osd.0 2023-03-03T07:43:44.482 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-03-03T07:43:44.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:44.684+0000 7f7bf1d70700 1 Processor -- start 2023-03-03T07:43:44.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:44.684+0000 7f7bf1d70700 1 -- start start 2023-03-03T07:43:44.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:44.684+0000 7f7bf1d70700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7bec12a180 0x7f7bec12a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:44.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:44.688+0000 7f7bf1d70700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bec08b4f0 con 0x7f7bec089f80 2023-03-03T07:43:44.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:44.688+0000 7f7bf1d70700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bec12aa90 con 0x7f7bec12a180 2023-03-03T07:43:44.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:44.688+0000 7f7bf0d6e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7bec12a180 0x7f7bec12a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:44.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:44.688+0000 7f7be3fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f7bec089f80 0x7f7bec08a420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56864/0 (socket says 172.21.15.57:56864) 2023-03-03T07:43:44.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:44.688+0000 7f7be3fff700 1 -- 172.21.15.57:0/1763865902 learned_addr learned my addr 172.21.15.57:0/1763865902 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:43:44.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:44.688+0000 7f7bf0d6e700 1 -- 172.21.15.57:0/1763865902 >> v1:172.21.15.57:6789/0 conn(0x7f7bec089f80 legacy=0x7f7bec08a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:44.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:44.688+0000 7f7bf0d6e700 1 -- 172.21.15.57:0/1763865902 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bec129b80 con 0x7f7bec12a180 2023-03-03T07:43:44.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:44.688+0000 7f7bf0d6e700 1 --2- 172.21.15.57:0/1763865902 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bec12a180 0x7f7bec12a550 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7be80097d0 tx=0x7f7be8009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70a14e111994ffb0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:44.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:44.688+0000 7f7be37fe700 1 -- 172.21.15.57:0/1763865902 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7be80041c0 con 0x7f7bec12a180 2023-03-03T07:43:44.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:44.688+0000 7f7be37fe700 1 -- 172.21.15.57:0/1763865902 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be8004320 con 0x7f7bec12a180 2023-03-03T07:43:44.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:44.688+0000 7f7be37fe700 1 -- 172.21.15.57:0/1763865902 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7be80036c0 con 0x7f7bec12a180 2023-03-03T07:43:44.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:44.692+0000 7f7bf1d70700 1 -- 172.21.15.57:0/1763865902 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bec12a180 msgr2=0x7f7bec12a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:44.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:44.692+0000 7f7bf1d70700 1 --2- 172.21.15.57:0/1763865902 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bec12a180 0x7f7bec12a550 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7be80097d0 tx=0x7f7be8009ae0 comp rx=0 tx=0).stop 2023-03-03T07:43:44.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:44.692+0000 7f7bf1d70700 1 -- 172.21.15.57:0/1763865902 shutdown_connections 2023-03-03T07:43:44.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:44.692+0000 7f7bf1d70700 1 --2- 172.21.15.57:0/1763865902 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bec12a180 0x7f7bec12a550 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:44.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:44.692+0000 7f7bf1d70700 1 -- 172.21.15.57:0/1763865902 >> 172.21.15.57:0/1763865902 conn(0x7f7bec06c840 msgr2=0x7f7bec06ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:44.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:44.692+0000 7f7bf1d70700 1 -- 172.21.15.57:0/1763865902 shutdown_connections 2023-03-03T07:43:44.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:44.692+0000 7f7bf1d70700 1 -- 172.21.15.57:0/1763865902 wait complete. 2023-03-03T07:43:44.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:44.692+0000 7f7bf1d70700 1 Processor -- start 2023-03-03T07:43:44.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:44.692+0000 7f7bf1d70700 1 -- start start 2023-03-03T07:43:44.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:44.696+0000 7f7bf1d70700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bec089f80 0x7f7bec12df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:44.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:44.696+0000 7f7bf1d70700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bec130170 con 0x7f7bec089f80 2023-03-03T07:43:44.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:44.696+0000 7f7bf0d6e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bec089f80 0x7f7bec12df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:44.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:44.696+0000 7f7bf0d6e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bec089f80 0x7f7bec12df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35730/0 (socket says 172.21.15.57:35730) 2023-03-03T07:43:44.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:44.696+0000 7f7bf0d6e700 1 -- 172.21.15.57:0/4080875319 learned_addr learned my addr 172.21.15.57:0/4080875319 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:44.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:44.696+0000 7f7bf0d6e700 1 -- 172.21.15.57:0/4080875319 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be80094b0 con 0x7f7bec089f80 2023-03-03T07:43:44.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:44.696+0000 7f7bf0d6e700 1 --2- 172.21.15.57:0/4080875319 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bec089f80 0x7f7bec12df10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7be8009b20 tx=0x7f7be8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:44.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:44.696+0000 7f7be17fa700 1 -- 172.21.15.57:0/4080875319 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7be8006ea0 con 0x7f7bec089f80 2023-03-03T07:43:44.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:44.696+0000 7f7bf1d70700 1 -- 172.21.15.57:0/4080875319 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bec08acc0 con 0x7f7bec089f80 2023-03-03T07:43:44.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:44.696+0000 7f7be17fa700 1 -- 172.21.15.57:0/4080875319 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be8011630 con 0x7f7bec089f80 2023-03-03T07:43:44.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:44.696+0000 7f7be17fa700 1 -- 172.21.15.57:0/4080875319 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7be80118d0 con 0x7f7bec089f80 2023-03-03T07:43:44.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:44.696+0000 7f7bf1d70700 1 -- 172.21.15.57:0/4080875319 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bec08ab30 con 0x7f7bec089f80 2023-03-03T07:43:44.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:44.700+0000 7f7bf1d70700 1 -- 172.21.15.57:0/4080875319 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bec08ae50 con 0x7f7bec089f80 2023-03-03T07:43:44.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:44.700+0000 7f7be17fa700 1 -- 172.21.15.57:0/4080875319 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42205+0+0 (secure 0 0 0) 0x7f7be800f050 con 0x7f7bec089f80 2023-03-03T07:43:44.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:44.700+0000 7f7be17fa700 1 --2- 172.21.15.57:0/4080875319 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f7bd80347f0 0x7f7bd8036ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:44.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:44.700+0000 7f7be17fa700 1 -- 172.21.15.57:0/4080875319 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2928+0+0 (secure 0 0 0) 0x7f7be8047320 con 0x7f7bec089f80 2023-03-03T07:43:44.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:44.700+0000 7f7be3fff700 1 --2- 172.21.15.57:0/4080875319 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f7bd80347f0 0x7f7bd8036ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:44.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:44.704+0000 7f7be3fff700 1 --2- 172.21.15.57:0/4080875319 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f7bd80347f0 0x7f7bd8036ca0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc0016a0 tx=0x7f7bdc007b70 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:44.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:44.708+0000 7f7be17fa700 1 -- 172.21.15.57:0/4080875319 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7be800b740 con 0x7f7bec089f80 2023-03-03T07:43:44.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:44.884+0000 7f7bf1d70700 1 -- 172.21.15.57:0/4080875319 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7bec0735a0 con 0x7f7bec089f80 2023-03-03T07:43:44.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:44.888+0000 7f7be17fa700 1 -- 172.21.15.57:0/4080875319 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7be8016070 con 0x7f7bec089f80 2023-03-03T07:43:44.893 INFO:teuthology.orchestra.run.smithi057.stdout:25769803781 2023-03-03T07:43:44.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:44.892+0000 7f7bf1d70700 1 -- 172.21.15.57:0/4080875319 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f7bd80347f0 msgr2=0x7f7bd8036ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:44.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:44.892+0000 7f7bf1d70700 1 --2- 172.21.15.57:0/4080875319 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f7bd80347f0 0x7f7bd8036ca0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc0016a0 tx=0x7f7bdc007b70 comp rx=0 tx=0).stop 2023-03-03T07:43:44.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:44.892+0000 7f7bf1d70700 1 -- 172.21.15.57:0/4080875319 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bec089f80 msgr2=0x7f7bec12df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:44.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:44.892+0000 7f7bf1d70700 1 --2- 172.21.15.57:0/4080875319 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bec089f80 0x7f7bec12df10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7be8009b20 tx=0x7f7be8004770 comp rx=0 tx=0).stop 2023-03-03T07:43:44.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:44.896+0000 7f7bf1d70700 1 -- 172.21.15.57:0/4080875319 shutdown_connections 2023-03-03T07:43:44.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:44.896+0000 7f7bf1d70700 1 --2- 172.21.15.57:0/4080875319 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f7bd80347f0 0x7f7bd8036ca0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:44.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:44.896+0000 7f7bf1d70700 1 --2- 172.21.15.57:0/4080875319 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bec089f80 0x7f7bec12df10 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:44.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:44.896+0000 7f7bf1d70700 1 -- 172.21.15.57:0/4080875319 >> 172.21.15.57:0/4080875319 conn(0x7f7bec06c840 msgr2=0x7f7bec06eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:44.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:44.896+0000 7f7bf1d70700 1 -- 172.21.15.57:0/4080875319 shutdown_connections 2023-03-03T07:43:44.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:44.896+0000 7f7bf1d70700 1 -- 172.21.15.57:0/4080875319 wait complete. 2023-03-03T07:43:44.934 INFO:tasks.ceph.ceph_manager.ceph:need seq 25769803783 got 25769803781 for osd.0 2023-03-03T07:43:45.935 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-03-03T07:43:46.149 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.144+0000 7fd29ed9a700 1 Processor -- start 2023-03-03T07:43:46.149 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.144+0000 7fd29ed9a700 1 -- start start 2023-03-03T07:43:46.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.144+0000 7fd29ed9a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd298070d40 0x7fd29808a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:46.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.144+0000 7fd29ed9a700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd29808b350 con 0x7fd298070970 2023-03-03T07:43:46.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.144+0000 7fd29ed9a700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd29808ae40 con 0x7fd298070d40 2023-03-03T07:43:46.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.148+0000 7fd29d597700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd298070d40 0x7fd29808a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:46.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.148+0000 7fd29dd98700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fd298070970 0x7fd29808a1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56870/0 (socket says 172.21.15.57:56870) 2023-03-03T07:43:46.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.148+0000 7fd29dd98700 1 -- 172.21.15.57:0/3214502524 learned_addr learned my addr 172.21.15.57:0/3214502524 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:43:46.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.148+0000 7fd29d597700 1 -- 172.21.15.57:0/3214502524 >> v1:172.21.15.57:6789/0 conn(0x7fd298070970 legacy=0x7fd29808a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:46.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.148+0000 7fd29d597700 1 -- 172.21.15.57:0/3214502524 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd298071620 con 0x7fd298070d40 2023-03-03T07:43:46.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.148+0000 7fd29cd96700 1 -- 172.21.15.57:0/3214502524 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2518678172 0 0) 0x7fd29808b350 con 0x7fd298070970 2023-03-03T07:43:46.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.148+0000 7fd29d597700 1 --2- 172.21.15.57:0/3214502524 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd298070d40 0x7fd29808a900 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd2880097d0 tx=0x7fd288009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=901f2c3d1ca86002 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:46.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.148+0000 7fd29cd96700 1 -- 172.21.15.57:0/3214502524 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd2880041c0 con 0x7fd298070d40 2023-03-03T07:43:46.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.148+0000 7fd29cd96700 1 -- 172.21.15.57:0/3214502524 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd288004320 con 0x7fd298070d40 2023-03-03T07:43:46.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.148+0000 7fd29cd96700 1 -- 172.21.15.57:0/3214502524 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd2880036c0 con 0x7fd298070d40 2023-03-03T07:43:46.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.148+0000 7fd29ed9a700 1 -- 172.21.15.57:0/3214502524 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd298070d40 msgr2=0x7fd29808a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:46.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.148+0000 7fd29ed9a700 1 --2- 172.21.15.57:0/3214502524 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd298070d40 0x7fd29808a900 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd2880097d0 tx=0x7fd288009ae0 comp rx=0 tx=0).stop 2023-03-03T07:43:46.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.148+0000 7fd29ed9a700 1 -- 172.21.15.57:0/3214502524 shutdown_connections 2023-03-03T07:43:46.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.148+0000 7fd29ed9a700 1 --2- 172.21.15.57:0/3214502524 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd298070d40 0x7fd29808a900 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:46.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.148+0000 7fd29ed9a700 1 -- 172.21.15.57:0/3214502524 >> 172.21.15.57:0/3214502524 conn(0x7fd29806c840 msgr2=0x7fd29806ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:46.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.152+0000 7fd29ed9a700 1 -- 172.21.15.57:0/3214502524 shutdown_connections 2023-03-03T07:43:46.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.152+0000 7fd29ed9a700 1 -- 172.21.15.57:0/3214502524 wait complete. 2023-03-03T07:43:46.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.152+0000 7fd29ed9a700 1 Processor -- start 2023-03-03T07:43:46.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.152+0000 7fd29ed9a700 1 -- start start 2023-03-03T07:43:46.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.156+0000 7fd29ed9a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd298070970 0x7fd2981203c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:46.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.156+0000 7fd29ed9a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd298121440 con 0x7fd298070970 2023-03-03T07:43:46.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.156+0000 7fd29dd98700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd298070970 0x7fd2981203c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:46.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.156+0000 7fd29dd98700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd298070970 0x7fd2981203c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35736/0 (socket says 172.21.15.57:35736) 2023-03-03T07:43:46.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.156+0000 7fd29dd98700 1 -- 172.21.15.57:0/3790937904 learned_addr learned my addr 172.21.15.57:0/3790937904 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:46.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.156+0000 7fd29dd98700 1 -- 172.21.15.57:0/3790937904 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2880094b0 con 0x7fd298070970 2023-03-03T07:43:46.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.156+0000 7fd29dd98700 1 --2- 172.21.15.57:0/3790937904 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd298070970 0x7fd2981203c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd29400c4d0 tx=0x7fd29400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:46.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.156+0000 7fd28e7fc700 1 -- 172.21.15.57:0/3790937904 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd294004bd0 con 0x7fd298070970 2023-03-03T07:43:46.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.156+0000 7fd28e7fc700 1 -- 172.21.15.57:0/3790937904 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd294004d50 con 0x7fd298070970 2023-03-03T07:43:46.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.156+0000 7fd29ed9a700 1 -- 172.21.15.57:0/3790937904 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd29812a2d0 con 0x7fd298070970 2023-03-03T07:43:46.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.156+0000 7fd28e7fc700 1 -- 172.21.15.57:0/3790937904 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd2940070d0 con 0x7fd298070970 2023-03-03T07:43:46.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.156+0000 7fd29ed9a700 1 -- 172.21.15.57:0/3790937904 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd29808ba60 con 0x7fd298070970 2023-03-03T07:43:46.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.160+0000 7fd29ed9a700 1 -- 172.21.15.57:0/3790937904 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd29812a460 con 0x7fd298070970 2023-03-03T07:43:46.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.160+0000 7fd28e7fc700 1 -- 172.21.15.57:0/3790937904 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42205+0+0 (secure 0 0 0) 0x7fd29401a020 con 0x7fd298070970 2023-03-03T07:43:46.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.160+0000 7fd28e7fc700 1 --2- 172.21.15.57:0/3790937904 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fd27c034890 0x7fd27c036d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:46.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.160+0000 7fd28e7fc700 1 -- 172.21.15.57:0/3790937904 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2928+0+0 (secure 0 0 0) 0x7fd294045d40 con 0x7fd298070970 2023-03-03T07:43:46.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.160+0000 7fd29d597700 1 --2- 172.21.15.57:0/3790937904 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fd27c034890 0x7fd27c036d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:46.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.164+0000 7fd29d597700 1 --2- 172.21.15.57:0/3790937904 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fd27c034890 0x7fd27c036d40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd288014040 tx=0x7fd288010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:46.173 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.168+0000 7fd28e7fc700 1 -- 172.21.15.57:0/3790937904 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd29401bda0 con 0x7fd298070970 2023-03-03T07:43:46.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.352+0000 7fd29ed9a700 1 -- 172.21.15.57:0/3790937904 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd2980619b0 con 0x7fd298070970 2023-03-03T07:43:46.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.352+0000 7fd28e7fc700 1 -- 172.21.15.57:0/3790937904 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd29401b340 con 0x7fd298070970 2023-03-03T07:43:46.358 INFO:teuthology.orchestra.run.smithi057.stdout:25769803783 2023-03-03T07:43:46.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.356+0000 7fd29ed9a700 1 -- 172.21.15.57:0/3790937904 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fd27c034890 msgr2=0x7fd27c036d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:46.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.356+0000 7fd29ed9a700 1 --2- 172.21.15.57:0/3790937904 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fd27c034890 0x7fd27c036d40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd288014040 tx=0x7fd288010000 comp rx=0 tx=0).stop 2023-03-03T07:43:46.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.356+0000 7fd29ed9a700 1 -- 172.21.15.57:0/3790937904 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd298070970 msgr2=0x7fd2981203c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:46.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.356+0000 7fd29ed9a700 1 --2- 172.21.15.57:0/3790937904 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd298070970 0x7fd2981203c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd29400c4d0 tx=0x7fd29400c890 comp rx=0 tx=0).stop 2023-03-03T07:43:46.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.356+0000 7fd29ed9a700 1 -- 172.21.15.57:0/3790937904 shutdown_connections 2023-03-03T07:43:46.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.356+0000 7fd29ed9a700 1 --2- 172.21.15.57:0/3790937904 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fd27c034890 0x7fd27c036d40 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:46.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.356+0000 7fd29ed9a700 1 --2- 172.21.15.57:0/3790937904 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd298070970 0x7fd2981203c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:46.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.356+0000 7fd29ed9a700 1 -- 172.21.15.57:0/3790937904 >> 172.21.15.57:0/3790937904 conn(0x7fd29806c840 msgr2=0x7fd2981af630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:46.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.356+0000 7fd29ed9a700 1 -- 172.21.15.57:0/3790937904 shutdown_connections 2023-03-03T07:43:46.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.356+0000 7fd29ed9a700 1 -- 172.21.15.57:0/3790937904 wait complete. 2023-03-03T07:43:46.393 INFO:tasks.ceph.ceph_manager.ceph:need seq 25769803783 got 25769803783 for osd.0 2023-03-03T07:43:46.393 DEBUG:teuthology.parallel:result is None 2023-03-03T07:43:46.394 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-03-03T07:43:46.394 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-03T07:43:46.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.596+0000 7f0cc1bf9700 1 Processor -- start 2023-03-03T07:43:46.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.596+0000 7f0cc1bf9700 1 -- start start 2023-03-03T07:43:46.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.596+0000 7f0cc1bf9700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0cbc124d60 0x7f0cbc125130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:46.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.596+0000 7f0cc1bf9700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cbc124620 con 0x7f0cbc08b090 2023-03-03T07:43:46.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.596+0000 7f0cc1bf9700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cbc08c2d0 con 0x7f0cbc124d60 2023-03-03T07:43:46.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.596+0000 7f0cbbfff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f0cbc08b090 0x7f0cbc08b530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56886/0 (socket says 172.21.15.57:56886) 2023-03-03T07:43:46.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.596+0000 7f0cbbfff700 1 -- 172.21.15.57:0/2242611056 learned_addr learned my addr 172.21.15.57:0/2242611056 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:43:46.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.596+0000 7f0cc0bf7700 1 --2- 172.21.15.57:0/2242611056 >> v2:172.21.15.57:3300/0 conn(0x7f0cbc124d60 0x7f0cbc125130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:46.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.596+0000 7f0cbb7fe700 1 -- 172.21.15.57:0/2242611056 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 688790923 0 0) 0x7f0cbc124620 con 0x7f0cbc08b090 2023-03-03T07:43:46.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.600+0000 7f0cbb7fe700 1 -- 172.21.15.57:0/2242611056 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cac0057e0 con 0x7f0cbc08b090 2023-03-03T07:43:46.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.600+0000 7f0cc0bf7700 1 -- 172.21.15.57:0/2242611056 >> v1:172.21.15.57:6789/0 conn(0x7f0cbc08b090 legacy=0x7f0cbc08b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:46.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.600+0000 7f0cc0bf7700 1 -- 172.21.15.57:0/2242611056 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cbc08c5e0 con 0x7f0cbc124d60 2023-03-03T07:43:46.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.600+0000 7f0cc0bf7700 1 --2- 172.21.15.57:0/2242611056 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cbc124d60 0x7f0cbc125130 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0cb00097d0 tx=0x7f0cb0009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1dbfd8b7c59770c server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:46.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.600+0000 7f0cbb7fe700 1 -- 172.21.15.57:0/2242611056 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0cb0004160 con 0x7f0cbc124d60 2023-03-03T07:43:46.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.600+0000 7f0cbb7fe700 1 -- 172.21.15.57:0/2242611056 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb00042c0 con 0x7f0cbc124d60 2023-03-03T07:43:46.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.600+0000 7f0cbb7fe700 1 -- 172.21.15.57:0/2242611056 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0cb00045a0 con 0x7f0cbc124d60 2023-03-03T07:43:46.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.600+0000 7f0cc1bf9700 1 -- 172.21.15.57:0/2242611056 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cbc124d60 msgr2=0x7f0cbc125130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:46.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.600+0000 7f0cc1bf9700 1 --2- 172.21.15.57:0/2242611056 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cbc124d60 0x7f0cbc125130 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0cb00097d0 tx=0x7f0cb0009ae0 comp rx=0 tx=0).stop 2023-03-03T07:43:46.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.600+0000 7f0cc1bf9700 1 -- 172.21.15.57:0/2242611056 shutdown_connections 2023-03-03T07:43:46.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.600+0000 7f0cc1bf9700 1 --2- 172.21.15.57:0/2242611056 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cbc124d60 0x7f0cbc125130 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:46.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.600+0000 7f0cc1bf9700 1 -- 172.21.15.57:0/2242611056 >> 172.21.15.57:0/2242611056 conn(0x7f0cbc06c840 msgr2=0x7f0cbc06ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:46.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.600+0000 7f0cc1bf9700 1 -- 172.21.15.57:0/2242611056 shutdown_connections 2023-03-03T07:43:46.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.600+0000 7f0cc1bf9700 1 -- 172.21.15.57:0/2242611056 wait complete. 2023-03-03T07:43:46.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.604+0000 7f0cc1bf9700 1 Processor -- start 2023-03-03T07:43:46.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.604+0000 7f0cc1bf9700 1 -- start start 2023-03-03T07:43:46.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.604+0000 7f0cc1bf9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cbc08b090 0x7f0cbc1aae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:46.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.604+0000 7f0cc1bf9700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cbc1ad4a0 con 0x7f0cbc08b090 2023-03-03T07:43:46.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.604+0000 7f0cc0bf7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cbc08b090 0x7f0cbc1aae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:46.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.604+0000 7f0cc0bf7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cbc08b090 0x7f0cbc1aae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35748/0 (socket says 172.21.15.57:35748) 2023-03-03T07:43:46.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.604+0000 7f0cc0bf7700 1 -- 172.21.15.57:0/4232626882 learned_addr learned my addr 172.21.15.57:0/4232626882 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:46.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.608+0000 7f0cc0bf7700 1 -- 172.21.15.57:0/4232626882 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb00094b0 con 0x7f0cbc08b090 2023-03-03T07:43:46.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.608+0000 7f0cc0bf7700 1 --2- 172.21.15.57:0/4232626882 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cbc08b090 0x7f0cbc1aae80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0cb00090b0 tx=0x7f0cb0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:46.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.608+0000 7f0cb97fa700 1 -- 172.21.15.57:0/4232626882 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0cb0003cc0 con 0x7f0cbc08b090 2023-03-03T07:43:46.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.608+0000 7f0cb97fa700 1 -- 172.21.15.57:0/4232626882 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb001f070 con 0x7f0cbc08b090 2023-03-03T07:43:46.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.608+0000 7f0cc1bf9700 1 -- 172.21.15.57:0/4232626882 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cbc08bdd0 con 0x7f0cbc08b090 2023-03-03T07:43:46.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.608+0000 7f0cb97fa700 1 -- 172.21.15.57:0/4232626882 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0cb0011630 con 0x7f0cbc08b090 2023-03-03T07:43:46.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.608+0000 7f0cc1bf9700 1 -- 172.21.15.57:0/4232626882 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cbc08bc40 con 0x7f0cbc08b090 2023-03-03T07:43:46.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.612+0000 7f0cb97fa700 1 -- 172.21.15.57:0/4232626882 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42205+0+0 (secure 0 0 0) 0x7f0cb002a020 con 0x7f0cbc08b090 2023-03-03T07:43:46.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.612+0000 7f0cc1bf9700 1 -- 172.21.15.57:0/4232626882 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cbc08bf60 con 0x7f0cbc08b090 2023-03-03T07:43:46.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.612+0000 7f0cb97fa700 1 --2- 172.21.15.57:0/4232626882 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f0ca0034830 0x7f0ca0036ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:46.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.612+0000 7f0cb97fa700 1 -- 172.21.15.57:0/4232626882 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2928+0+0 (secure 0 0 0) 0x7f0cb0047830 con 0x7f0cbc08b090 2023-03-03T07:43:46.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.612+0000 7f0cbbfff700 1 --2- 172.21.15.57:0/4232626882 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f0ca0034830 0x7f0ca0036ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:46.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.616+0000 7f0cbbfff700 1 --2- 172.21.15.57:0/4232626882 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f0ca0034830 0x7f0ca0036ce0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0ca80011e0 tx=0x7f0ca8007a20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:46.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.620+0000 7f0cb97fa700 1 -- 172.21.15.57:0/4232626882 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f0cb0010380 con 0x7f0cbc08b090 2023-03-03T07:43:46.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.792+0000 7f0cc1bf9700 1 -- 172.21.15.57:0/4232626882 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0cbc0619b0 con 0x7f0ca0034830 2023-03-03T07:43:46.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.804+0000 7f0cb97fa700 1 -- 172.21.15.57:0/4232626882 <== mgr.4099 v2:172.21.15.57:6808/28565 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+263639 (secure 0 0 0) 0x7f0cbc0619b0 con 0x7f0ca0034830 2023-03-03T07:43:46.815 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-03T07:43:46.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.816+0000 7f0cc1bf9700 1 -- 172.21.15.57:0/4232626882 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f0ca0034830 msgr2=0x7f0ca0036ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:46.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.816+0000 7f0cc1bf9700 1 --2- 172.21.15.57:0/4232626882 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f0ca0034830 0x7f0ca0036ce0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0ca80011e0 tx=0x7f0ca8007a20 comp rx=0 tx=0).stop 2023-03-03T07:43:46.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.816+0000 7f0cc1bf9700 1 -- 172.21.15.57:0/4232626882 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cbc08b090 msgr2=0x7f0cbc1aae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:46.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.816+0000 7f0cc1bf9700 1 --2- 172.21.15.57:0/4232626882 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cbc08b090 0x7f0cbc1aae80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0cb00090b0 tx=0x7f0cb0004770 comp rx=0 tx=0).stop 2023-03-03T07:43:46.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.816+0000 7f0cc1bf9700 1 -- 172.21.15.57:0/4232626882 shutdown_connections 2023-03-03T07:43:46.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.816+0000 7f0cc1bf9700 1 --2- 172.21.15.57:0/4232626882 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f0ca0034830 0x7f0ca0036ce0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:46.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.816+0000 7f0cc1bf9700 1 --2- 172.21.15.57:0/4232626882 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cbc08b090 0x7f0cbc1aae80 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:46.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.816+0000 7f0cc1bf9700 1 -- 172.21.15.57:0/4232626882 >> 172.21.15.57:0/4232626882 conn(0x7f0cbc06c840 msgr2=0x7f0cbc0951c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:46.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.816+0000 7f0cc1bf9700 1 -- 172.21.15.57:0/4232626882 shutdown_connections 2023-03-03T07:43:46.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:46.816+0000 7f0cc1bf9700 1 -- 172.21.15.57:0/4232626882 wait complete. 2023-03-03T07:43:46.826 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-03-03T07:43:46.853 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-03-03T07:43:46.755265+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":24,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":182,"num_write_kb":1908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":136,"ondisk_log_size":136,"up":105,"acting":105,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":1048576,"kb_used":9332,"kb_used_data":748,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":1039244,"statfs":{"total":1073741824,"available":1064185856,"internally_reserved":0,"allocated":765952,"data_stored":631325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002798"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381705+0000","last_change":"2023-03-03T07:43:36.393637+0000","last_active":"2023-03-03T07:43:37.381705+0000","last_peered":"2023-03-03T07:43:37.381705+0000","last_clean":"2023-03-03T07:43:37.381705+0000","last_became_active":"2023-03-03T07:43:36.390086+0000","last_became_peered":"2023-03-03T07:43:36.390086+0000","last_unstale":"2023-03-03T07:43:37.381705+0000","last_undegraded":"2023-03-03T07:43:37.381705+0000","last_fullsized":"2023-03-03T07:43:37.381705+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:09:00.550158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378654+0000","last_change":"2023-03-03T07:43:36.387799+0000","last_active":"2023-03-03T07:43:37.378654+0000","last_peered":"2023-03-03T07:43:37.378654+0000","last_clean":"2023-03-03T07:43:37.378654+0000","last_became_active":"2023-03-03T07:43:36.386845+0000","last_became_peered":"2023-03-03T07:43:36.386845+0000","last_unstale":"2023-03-03T07:43:37.378654+0000","last_undegraded":"2023-03-03T07:43:37.378654+0000","last_fullsized":"2023-03-03T07:43:37.378654+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:17:33.673790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378497+0000","last_change":"2023-03-03T07:43:36.386277+0000","last_active":"2023-03-03T07:43:37.378497+0000","last_peered":"2023-03-03T07:43:37.378497+0000","last_clean":"2023-03-03T07:43:37.378497+0000","last_became_active":"2023-03-03T07:43:36.385656+0000","last_became_peered":"2023-03-03T07:43:36.385656+0000","last_unstale":"2023-03-03T07:43:37.378497+0000","last_undegraded":"2023-03-03T07:43:37.378497+0000","last_fullsized":"2023-03-03T07:43:37.378497+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:58:46.265569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378072+0000","last_change":"2023-03-03T07:43:36.386488+0000","last_active":"2023-03-03T07:43:37.378072+0000","last_peered":"2023-03-03T07:43:37.378072+0000","last_clean":"2023-03-03T07:43:37.378072+0000","last_became_active":"2023-03-03T07:43:36.385676+0000","last_became_peered":"2023-03-03T07:43:36.385676+0000","last_unstale":"2023-03-03T07:43:37.378072+0000","last_undegraded":"2023-03-03T07:43:37.378072+0000","last_fullsized":"2023-03-03T07:43:37.378072+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T19:10:46.103525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378425+0000","last_change":"2023-03-03T07:43:36.387609+0000","last_active":"2023-03-03T07:43:37.378425+0000","last_peered":"2023-03-03T07:43:37.378425+0000","last_clean":"2023-03-03T07:43:37.378425+0000","last_became_active":"2023-03-03T07:43:36.386787+0000","last_became_peered":"2023-03-03T07:43:36.386787+0000","last_unstale":"2023-03-03T07:43:37.378425+0000","last_undegraded":"2023-03-03T07:43:37.378425+0000","last_fullsized":"2023-03-03T07:43:37.378425+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:55:23.671272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377578+0000","last_change":"2023-03-03T07:43:36.391967+0000","last_active":"2023-03-03T07:43:37.377578+0000","last_peered":"2023-03-03T07:43:37.377578+0000","last_clean":"2023-03-03T07:43:37.377578+0000","last_became_active":"2023-03-03T07:43:36.388336+0000","last_became_peered":"2023-03-03T07:43:36.388336+0000","last_unstale":"2023-03-03T07:43:37.377578+0000","last_undegraded":"2023-03-03T07:43:37.377578+0000","last_fullsized":"2023-03-03T07:43:37.377578+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:00:15.483477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377385+0000","last_change":"2023-03-03T07:43:36.389899+0000","last_active":"2023-03-03T07:43:37.377385+0000","last_peered":"2023-03-03T07:43:37.377385+0000","last_clean":"2023-03-03T07:43:37.377385+0000","last_became_active":"2023-03-03T07:43:36.388351+0000","last_became_peered":"2023-03-03T07:43:36.388351+0000","last_unstale":"2023-03-03T07:43:37.377385+0000","last_undegraded":"2023-03-03T07:43:37.377385+0000","last_fullsized":"2023-03-03T07:43:37.377385+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:56:41.946658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377189+0000","last_change":"2023-03-03T07:43:36.384986+0000","last_active":"2023-03-03T07:43:37.377189+0000","last_peered":"2023-03-03T07:43:37.377189+0000","last_clean":"2023-03-03T07:43:37.377189+0000","last_became_active":"2023-03-03T07:43:36.383623+0000","last_became_peered":"2023-03-03T07:43:36.383623+0000","last_unstale":"2023-03-03T07:43:37.377189+0000","last_undegraded":"2023-03-03T07:43:37.377189+0000","last_fullsized":"2023-03-03T07:43:37.377189+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:23:12.419718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381830+0000","last_change":"2023-03-03T07:43:36.393726+0000","last_active":"2023-03-03T07:43:37.381830+0000","last_peered":"2023-03-03T07:43:37.381830+0000","last_clean":"2023-03-03T07:43:37.381830+0000","last_became_active":"2023-03-03T07:43:36.393246+0000","last_became_peered":"2023-03-03T07:43:36.393246+0000","last_unstale":"2023-03-03T07:43:37.381830+0000","last_undegraded":"2023-03-03T07:43:37.381830+0000","last_fullsized":"2023-03-03T07:43:37.381830+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:16:15.865411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378876+0000","last_change":"2023-03-03T07:43:36.386834+0000","last_active":"2023-03-03T07:43:37.378876+0000","last_peered":"2023-03-03T07:43:37.378876+0000","last_clean":"2023-03-03T07:43:37.378876+0000","last_became_active":"2023-03-03T07:43:36.386194+0000","last_became_peered":"2023-03-03T07:43:36.386194+0000","last_unstale":"2023-03-03T07:43:37.378876+0000","last_undegraded":"2023-03-03T07:43:37.378876+0000","last_fullsized":"2023-03-03T07:43:37.378876+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:55:32.472776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378632+0000","last_change":"2023-03-03T07:43:36.389629+0000","last_active":"2023-03-03T07:43:37.378632+0000","last_peered":"2023-03-03T07:43:37.378632+0000","last_clean":"2023-03-03T07:43:37.378632+0000","last_became_active":"2023-03-03T07:43:36.386514+0000","last_became_peered":"2023-03-03T07:43:36.386514+0000","last_unstale":"2023-03-03T07:43:37.378632+0000","last_undegraded":"2023-03-03T07:43:37.378632+0000","last_fullsized":"2023-03-03T07:43:37.378632+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:30:34.330114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378087+0000","last_change":"2023-03-03T07:43:36.392007+0000","last_active":"2023-03-03T07:43:37.378087+0000","last_peered":"2023-03-03T07:43:37.378087+0000","last_clean":"2023-03-03T07:43:37.378087+0000","last_became_active":"2023-03-03T07:43:36.387855+0000","last_became_peered":"2023-03-03T07:43:36.387855+0000","last_unstale":"2023-03-03T07:43:37.378087+0000","last_undegraded":"2023-03-03T07:43:37.378087+0000","last_fullsized":"2023-03-03T07:43:37.378087+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:36:55.997614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378670+0000","last_change":"2023-03-03T07:43:36.391658+0000","last_active":"2023-03-03T07:43:37.378670+0000","last_peered":"2023-03-03T07:43:37.378670+0000","last_clean":"2023-03-03T07:43:37.378670+0000","last_became_active":"2023-03-03T07:43:36.390126+0000","last_became_peered":"2023-03-03T07:43:36.390126+0000","last_unstale":"2023-03-03T07:43:37.378670+0000","last_undegraded":"2023-03-03T07:43:37.378670+0000","last_fullsized":"2023-03-03T07:43:37.378670+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:32:20.715403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377774+0000","last_change":"2023-03-03T07:43:36.381795+0000","last_active":"2023-03-03T07:43:37.377774+0000","last_peered":"2023-03-03T07:43:37.377774+0000","last_clean":"2023-03-03T07:43:37.377774+0000","last_became_active":"2023-03-03T07:43:36.380678+0000","last_became_peered":"2023-03-03T07:43:36.380678+0000","last_unstale":"2023-03-03T07:43:37.377774+0000","last_undegraded":"2023-03-03T07:43:37.377774+0000","last_fullsized":"2023-03-03T07:43:37.377774+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:49:53.962269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377318+0000","last_change":"2023-03-03T07:43:36.381452+0000","last_active":"2023-03-03T07:43:37.377318+0000","last_peered":"2023-03-03T07:43:37.377318+0000","last_clean":"2023-03-03T07:43:37.377318+0000","last_became_active":"2023-03-03T07:43:36.380631+0000","last_became_peered":"2023-03-03T07:43:36.380631+0000","last_unstale":"2023-03-03T07:43:37.377318+0000","last_undegraded":"2023-03-03T07:43:37.377318+0000","last_fullsized":"2023-03-03T07:43:37.377318+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:35:31.851815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378787+0000","last_change":"2023-03-03T07:43:36.386485+0000","last_active":"2023-03-03T07:43:37.378787+0000","last_peered":"2023-03-03T07:43:37.378787+0000","last_clean":"2023-03-03T07:43:37.378787+0000","last_became_active":"2023-03-03T07:43:36.385872+0000","last_became_peered":"2023-03-03T07:43:36.385872+0000","last_unstale":"2023-03-03T07:43:37.378787+0000","last_undegraded":"2023-03-03T07:43:37.378787+0000","last_fullsized":"2023-03-03T07:43:37.378787+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:40:02.564993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381949+0000","last_change":"2023-03-03T07:43:36.393749+0000","last_active":"2023-03-03T07:43:37.381949+0000","last_peered":"2023-03-03T07:43:37.381949+0000","last_clean":"2023-03-03T07:43:37.381949+0000","last_became_active":"2023-03-03T07:43:36.393288+0000","last_became_peered":"2023-03-03T07:43:36.393288+0000","last_unstale":"2023-03-03T07:43:37.381949+0000","last_undegraded":"2023-03-03T07:43:37.381949+0000","last_fullsized":"2023-03-03T07:43:37.381949+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:17:21.911716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379562+0000","last_change":"2023-03-03T07:43:36.391355+0000","last_active":"2023-03-03T07:43:37.379562+0000","last_peered":"2023-03-03T07:43:37.379562+0000","last_clean":"2023-03-03T07:43:37.379562+0000","last_became_active":"2023-03-03T07:43:36.387820+0000","last_became_peered":"2023-03-03T07:43:36.387820+0000","last_unstale":"2023-03-03T07:43:37.379562+0000","last_undegraded":"2023-03-03T07:43:37.379562+0000","last_fullsized":"2023-03-03T07:43:37.379562+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:22:59.608795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378766+0000","last_change":"2023-03-03T07:43:36.390057+0000","last_active":"2023-03-03T07:43:37.378766+0000","last_peered":"2023-03-03T07:43:37.378766+0000","last_clean":"2023-03-03T07:43:37.378766+0000","last_became_active":"2023-03-03T07:43:36.386741+0000","last_became_peered":"2023-03-03T07:43:36.386741+0000","last_unstale":"2023-03-03T07:43:37.378766+0000","last_undegraded":"2023-03-03T07:43:37.378766+0000","last_fullsized":"2023-03-03T07:43:37.378766+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:40:12.577170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378610+0000","last_change":"2023-03-03T07:43:36.393152+0000","last_active":"2023-03-03T07:43:37.378610+0000","last_peered":"2023-03-03T07:43:37.378610+0000","last_clean":"2023-03-03T07:43:37.378610+0000","last_became_active":"2023-03-03T07:43:36.388370+0000","last_became_peered":"2023-03-03T07:43:36.388370+0000","last_unstale":"2023-03-03T07:43:37.378610+0000","last_undegraded":"2023-03-03T07:43:37.378610+0000","last_fullsized":"2023-03-03T07:43:37.378610+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:52:19.250036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378810+0000","last_change":"2023-03-03T07:43:36.391466+0000","last_active":"2023-03-03T07:43:37.378810+0000","last_peered":"2023-03-03T07:43:37.378810+0000","last_clean":"2023-03-03T07:43:37.378810+0000","last_became_active":"2023-03-03T07:43:36.389987+0000","last_became_peered":"2023-03-03T07:43:36.389987+0000","last_unstale":"2023-03-03T07:43:37.378810+0000","last_undegraded":"2023-03-03T07:43:37.378810+0000","last_fullsized":"2023-03-03T07:43:37.378810+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:06:52.630210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377996+0000","last_change":"2023-03-03T07:43:36.383091+0000","last_active":"2023-03-03T07:43:37.377996+0000","last_peered":"2023-03-03T07:43:37.377996+0000","last_clean":"2023-03-03T07:43:37.377996+0000","last_became_active":"2023-03-03T07:43:36.380994+0000","last_became_peered":"2023-03-03T07:43:36.380994+0000","last_unstale":"2023-03-03T07:43:37.377996+0000","last_undegraded":"2023-03-03T07:43:37.377996+0000","last_fullsized":"2023-03-03T07:43:37.377996+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:18:41.788833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377524+0000","last_change":"2023-03-03T07:43:36.381681+0000","last_active":"2023-03-03T07:43:37.377524+0000","last_peered":"2023-03-03T07:43:37.377524+0000","last_clean":"2023-03-03T07:43:37.377524+0000","last_became_active":"2023-03-03T07:43:36.380651+0000","last_became_peered":"2023-03-03T07:43:36.380651+0000","last_unstale":"2023-03-03T07:43:37.377524+0000","last_undegraded":"2023-03-03T07:43:37.377524+0000","last_fullsized":"2023-03-03T07:43:37.377524+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:54:39.635086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377877+0000","last_change":"2023-03-03T07:43:36.387612+0000","last_active":"2023-03-03T07:43:37.377877+0000","last_peered":"2023-03-03T07:43:37.377877+0000","last_clean":"2023-03-03T07:43:37.377877+0000","last_became_active":"2023-03-03T07:43:36.386495+0000","last_became_peered":"2023-03-03T07:43:36.386495+0000","last_unstale":"2023-03-03T07:43:37.377877+0000","last_undegraded":"2023-03-03T07:43:37.377877+0000","last_fullsized":"2023-03-03T07:43:37.377877+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:32:02.438980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378481+0000","last_change":"2023-03-03T07:43:36.393652+0000","last_active":"2023-03-03T07:43:37.378481+0000","last_peered":"2023-03-03T07:43:37.378481+0000","last_clean":"2023-03-03T07:43:37.378481+0000","last_became_active":"2023-03-03T07:43:36.392133+0000","last_became_peered":"2023-03-03T07:43:36.392133+0000","last_unstale":"2023-03-03T07:43:37.378481+0000","last_undegraded":"2023-03-03T07:43:37.378481+0000","last_fullsized":"2023-03-03T07:43:37.378481+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:11:04.212221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381267+0000","last_change":"2023-03-03T07:43:36.391612+0000","last_active":"2023-03-03T07:43:37.381267+0000","last_peered":"2023-03-03T07:43:37.381267+0000","last_clean":"2023-03-03T07:43:37.381267+0000","last_became_active":"2023-03-03T07:43:36.388016+0000","last_became_peered":"2023-03-03T07:43:36.388016+0000","last_unstale":"2023-03-03T07:43:37.381267+0000","last_undegraded":"2023-03-03T07:43:37.381267+0000","last_fullsized":"2023-03-03T07:43:37.381267+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:57:04.070413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381222+0000","last_change":"2023-03-03T07:43:36.391717+0000","last_active":"2023-03-03T07:43:37.381222+0000","last_peered":"2023-03-03T07:43:37.381222+0000","last_clean":"2023-03-03T07:43:37.381222+0000","last_became_active":"2023-03-03T07:43:36.389768+0000","last_became_peered":"2023-03-03T07:43:36.389768+0000","last_unstale":"2023-03-03T07:43:37.381222+0000","last_undegraded":"2023-03-03T07:43:37.381222+0000","last_fullsized":"2023-03-03T07:43:37.381222+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:55:53.276950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379612+0000","last_change":"2023-03-03T07:43:36.393425+0000","last_active":"2023-03-03T07:43:37.379612+0000","last_peered":"2023-03-03T07:43:37.379612+0000","last_clean":"2023-03-03T07:43:37.379612+0000","last_became_active":"2023-03-03T07:43:36.391732+0000","last_became_peered":"2023-03-03T07:43:36.391732+0000","last_unstale":"2023-03-03T07:43:37.379612+0000","last_undegraded":"2023-03-03T07:43:37.379612+0000","last_fullsized":"2023-03-03T07:43:37.379612+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:45:17.493745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379072+0000","last_change":"2023-03-03T07:43:36.391823+0000","last_active":"2023-03-03T07:43:37.379072+0000","last_peered":"2023-03-03T07:43:37.379072+0000","last_clean":"2023-03-03T07:43:37.379072+0000","last_became_active":"2023-03-03T07:43:36.390288+0000","last_became_peered":"2023-03-03T07:43:36.390288+0000","last_unstale":"2023-03-03T07:43:37.379072+0000","last_undegraded":"2023-03-03T07:43:37.379072+0000","last_fullsized":"2023-03-03T07:43:37.379072+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:01:41.404103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378369+0000","last_change":"2023-03-03T07:43:36.383274+0000","last_active":"2023-03-03T07:43:37.378369+0000","last_peered":"2023-03-03T07:43:37.378369+0000","last_clean":"2023-03-03T07:43:37.378369+0000","last_became_active":"2023-03-03T07:43:36.381293+0000","last_became_peered":"2023-03-03T07:43:36.381293+0000","last_unstale":"2023-03-03T07:43:37.378369+0000","last_undegraded":"2023-03-03T07:43:37.378369+0000","last_fullsized":"2023-03-03T07:43:37.378369+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:27:20.763746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377615+0000","last_change":"2023-03-03T07:43:36.382637+0000","last_active":"2023-03-03T07:43:37.377615+0000","last_peered":"2023-03-03T07:43:37.377615+0000","last_clean":"2023-03-03T07:43:37.377615+0000","last_became_active":"2023-03-03T07:43:36.380941+0000","last_became_peered":"2023-03-03T07:43:36.380941+0000","last_unstale":"2023-03-03T07:43:37.377615+0000","last_undegraded":"2023-03-03T07:43:37.377615+0000","last_fullsized":"2023-03-03T07:43:37.377615+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:44:54.128297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377722+0000","last_change":"2023-03-03T07:43:36.385403+0000","last_active":"2023-03-03T07:43:37.377722+0000","last_peered":"2023-03-03T07:43:37.377722+0000","last_clean":"2023-03-03T07:43:37.377722+0000","last_became_active":"2023-03-03T07:43:36.384809+0000","last_became_peered":"2023-03-03T07:43:36.384809+0000","last_unstale":"2023-03-03T07:43:37.377722+0000","last_undegraded":"2023-03-03T07:43:37.377722+0000","last_fullsized":"2023-03-03T07:43:37.377722+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:40:13.258572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379386+0000","last_change":"2023-03-03T07:43:36.393487+0000","last_active":"2023-03-03T07:43:37.379386+0000","last_peered":"2023-03-03T07:43:37.379386+0000","last_clean":"2023-03-03T07:43:37.379386+0000","last_became_active":"2023-03-03T07:43:36.391768+0000","last_became_peered":"2023-03-03T07:43:36.391768+0000","last_unstale":"2023-03-03T07:43:37.379386+0000","last_undegraded":"2023-03-03T07:43:37.379386+0000","last_fullsized":"2023-03-03T07:43:37.379386+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:06:47.610243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378943+0000","last_change":"2023-03-03T07:43:35.895264+0000","last_active":"2023-03-03T07:43:37.378943+0000","last_peered":"2023-03-03T07:43:37.378943+0000","last_clean":"2023-03-03T07:43:37.378943+0000","last_became_active":"2023-03-03T07:43:35.894159+0000","last_became_peered":"2023-03-03T07:43:35.894159+0000","last_unstale":"2023-03-03T07:43:37.378943+0000","last_undegraded":"2023-03-03T07:43:37.378943+0000","last_fullsized":"2023-03-03T07:43:37.378943+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:51:45.982631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378998+0000","last_change":"2023-03-03T07:43:36.390239+0000","last_active":"2023-03-03T07:43:37.378998+0000","last_peered":"2023-03-03T07:43:37.378998+0000","last_clean":"2023-03-03T07:43:37.378998+0000","last_became_active":"2023-03-03T07:43:36.387807+0000","last_became_peered":"2023-03-03T07:43:36.387807+0000","last_unstale":"2023-03-03T07:43:37.378998+0000","last_undegraded":"2023-03-03T07:43:37.378998+0000","last_fullsized":"2023-03-03T07:43:37.378998+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:03:09.938807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378723+0000","last_change":"2023-03-03T07:43:35.888766+0000","last_active":"2023-03-03T07:43:37.378723+0000","last_peered":"2023-03-03T07:43:37.378723+0000","last_clean":"2023-03-03T07:43:37.378723+0000","last_became_active":"2023-03-03T07:43:35.888475+0000","last_became_peered":"2023-03-03T07:43:35.888475+0000","last_unstale":"2023-03-03T07:43:37.378723+0000","last_undegraded":"2023-03-03T07:43:37.378723+0000","last_fullsized":"2023-03-03T07:43:37.378723+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:38:06.266060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381468+0000","last_change":"2023-03-03T07:43:36.392191+0000","last_active":"2023-03-03T07:43:37.381468+0000","last_peered":"2023-03-03T07:43:37.381468+0000","last_clean":"2023-03-03T07:43:37.381468+0000","last_became_active":"2023-03-03T07:43:36.391967+0000","last_became_peered":"2023-03-03T07:43:36.391967+0000","last_unstale":"2023-03-03T07:43:37.381468+0000","last_undegraded":"2023-03-03T07:43:37.381468+0000","last_fullsized":"2023-03-03T07:43:37.381468+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:05:12.083235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378253+0000","last_change":"2023-03-03T07:43:35.877502+0000","last_active":"2023-03-03T07:43:37.378253+0000","last_peered":"2023-03-03T07:43:37.378253+0000","last_clean":"2023-03-03T07:43:37.378253+0000","last_became_active":"2023-03-03T07:43:35.876095+0000","last_became_peered":"2023-03-03T07:43:35.876095+0000","last_unstale":"2023-03-03T07:43:37.378253+0000","last_undegraded":"2023-03-03T07:43:37.378253+0000","last_fullsized":"2023-03-03T07:43:37.378253+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:04:51.085090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381278+0000","last_change":"2023-03-03T07:43:36.388187+0000","last_active":"2023-03-03T07:43:37.381278+0000","last_peered":"2023-03-03T07:43:37.381278+0000","last_clean":"2023-03-03T07:43:37.381278+0000","last_became_active":"2023-03-03T07:43:36.385750+0000","last_became_peered":"2023-03-03T07:43:36.385750+0000","last_unstale":"2023-03-03T07:43:37.381278+0000","last_undegraded":"2023-03-03T07:43:37.381278+0000","last_fullsized":"2023-03-03T07:43:37.381278+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:53:04.087750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"15'8","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377423+0000","last_change":"2023-03-03T07:43:35.885608+0000","last_active":"2023-03-03T07:43:37.377423+0000","last_peered":"2023-03-03T07:43:37.377423+0000","last_clean":"2023-03-03T07:43:37.377423+0000","last_became_active":"2023-03-03T07:43:35.882827+0000","last_became_peered":"2023-03-03T07:43:35.882827+0000","last_unstale":"2023-03-03T07:43:37.377423+0000","last_undegraded":"2023-03-03T07:43:37.377423+0000","last_fullsized":"2023-03-03T07:43:37.377423+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:10:08.916806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381936+0000","last_change":"2023-03-03T07:43:35.895617+0000","last_active":"2023-03-03T07:43:37.381936+0000","last_peered":"2023-03-03T07:43:37.381936+0000","last_clean":"2023-03-03T07:43:37.381936+0000","last_became_active":"2023-03-03T07:43:35.894656+0000","last_became_peered":"2023-03-03T07:43:35.894656+0000","last_unstale":"2023-03-03T07:43:37.381936+0000","last_undegraded":"2023-03-03T07:43:37.381936+0000","last_fullsized":"2023-03-03T07:43:37.381936+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:16:23.316589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":1,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377586+0000","last_change":"2023-03-03T07:43:36.385247+0000","last_active":"2023-03-03T07:43:37.377586+0000","last_peered":"2023-03-03T07:43:37.377586+0000","last_clean":"2023-03-03T07:43:37.377586+0000","last_became_active":"2023-03-03T07:43:36.384566+0000","last_became_peered":"2023-03-03T07:43:36.384566+0000","last_unstale":"2023-03-03T07:43:37.377586+0000","last_undegraded":"2023-03-03T07:43:37.377586+0000","last_fullsized":"2023-03-03T07:43:37.377586+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:13:56.887766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381435+0000","last_change":"2023-03-03T07:43:35.896637+0000","last_active":"2023-03-03T07:43:37.381435+0000","last_peered":"2023-03-03T07:43:37.381435+0000","last_clean":"2023-03-03T07:43:37.381435+0000","last_became_active":"2023-03-03T07:43:35.896121+0000","last_became_peered":"2023-03-03T07:43:35.896121+0000","last_unstale":"2023-03-03T07:43:37.381435+0000","last_undegraded":"2023-03-03T07:43:37.381435+0000","last_fullsized":"2023-03-03T07:43:37.381435+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:48:03.998157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":1,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377802+0000","last_change":"2023-03-03T07:43:36.382904+0000","last_active":"2023-03-03T07:43:37.377802+0000","last_peered":"2023-03-03T07:43:37.377802+0000","last_clean":"2023-03-03T07:43:37.377802+0000","last_became_active":"2023-03-03T07:43:36.382660+0000","last_became_peered":"2023-03-03T07:43:36.382660+0000","last_unstale":"2023-03-03T07:43:37.377802+0000","last_undegraded":"2023-03-03T07:43:37.377802+0000","last_fullsized":"2023-03-03T07:43:37.377802+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:08:38.514550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379594+0000","last_change":"2023-03-03T07:43:35.895808+0000","last_active":"2023-03-03T07:43:37.379594+0000","last_peered":"2023-03-03T07:43:37.379594+0000","last_clean":"2023-03-03T07:43:37.379594+0000","last_became_active":"2023-03-03T07:43:35.895529+0000","last_became_peered":"2023-03-03T07:43:35.895529+0000","last_unstale":"2023-03-03T07:43:37.379594+0000","last_undegraded":"2023-03-03T07:43:37.379594+0000","last_fullsized":"2023-03-03T07:43:37.379594+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:42:17.118297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":1,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379159+0000","last_change":"2023-03-03T07:43:36.392148+0000","last_active":"2023-03-03T07:43:37.379159+0000","last_peered":"2023-03-03T07:43:37.379159+0000","last_clean":"2023-03-03T07:43:37.379159+0000","last_became_active":"2023-03-03T07:43:36.391440+0000","last_became_peered":"2023-03-03T07:43:36.391440+0000","last_unstale":"2023-03-03T07:43:37.379159+0000","last_undegraded":"2023-03-03T07:43:37.379159+0000","last_fullsized":"2023-03-03T07:43:37.379159+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:17:49.134435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379489+0000","last_change":"2023-03-03T07:43:35.895938+0000","last_active":"2023-03-03T07:43:37.379489+0000","last_peered":"2023-03-03T07:43:37.379489+0000","last_clean":"2023-03-03T07:43:37.379489+0000","last_became_active":"2023-03-03T07:43:35.895196+0000","last_became_peered":"2023-03-03T07:43:35.895196+0000","last_unstale":"2023-03-03T07:43:37.379489+0000","last_undegraded":"2023-03-03T07:43:37.379489+0000","last_fullsized":"2023-03-03T07:43:37.379489+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:09:18.543009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378191+0000","last_change":"2023-03-03T07:43:36.391749+0000","last_active":"2023-03-03T07:43:37.378191+0000","last_peered":"2023-03-03T07:43:37.378191+0000","last_clean":"2023-03-03T07:43:37.378191+0000","last_became_active":"2023-03-03T07:43:36.389888+0000","last_became_peered":"2023-03-03T07:43:36.389888+0000","last_unstale":"2023-03-03T07:43:37.378191+0000","last_undegraded":"2023-03-03T07:43:37.378191+0000","last_fullsized":"2023-03-03T07:43:37.378191+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:06:24.364753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"15'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379694+0000","last_change":"2023-03-03T07:43:35.895961+0000","last_active":"2023-03-03T07:43:37.379694+0000","last_peered":"2023-03-03T07:43:37.379694+0000","last_clean":"2023-03-03T07:43:37.379694+0000","last_became_active":"2023-03-03T07:43:35.894409+0000","last_became_peered":"2023-03-03T07:43:35.894409+0000","last_unstale":"2023-03-03T07:43:37.379694+0000","last_undegraded":"2023-03-03T07:43:37.379694+0000","last_fullsized":"2023-03-03T07:43:37.379694+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:34:04.674852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":1,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378795+0000","last_change":"2023-03-03T07:43:36.393323+0000","last_active":"2023-03-03T07:43:37.378795+0000","last_peered":"2023-03-03T07:43:37.378795+0000","last_clean":"2023-03-03T07:43:37.378795+0000","last_became_active":"2023-03-03T07:43:36.391375+0000","last_became_peered":"2023-03-03T07:43:36.391375+0000","last_unstale":"2023-03-03T07:43:37.378795+0000","last_undegraded":"2023-03-03T07:43:37.378795+0000","last_fullsized":"2023-03-03T07:43:37.378795+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:50:37.609201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378961+0000","last_change":"2023-03-03T07:43:35.894763+0000","last_active":"2023-03-03T07:43:37.378961+0000","last_peered":"2023-03-03T07:43:37.378961+0000","last_clean":"2023-03-03T07:43:37.378961+0000","last_became_active":"2023-03-03T07:43:35.894469+0000","last_became_peered":"2023-03-03T07:43:35.894469+0000","last_unstale":"2023-03-03T07:43:37.378961+0000","last_undegraded":"2023-03-03T07:43:37.378961+0000","last_fullsized":"2023-03-03T07:43:37.378961+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:36:02.233356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379216+0000","last_change":"2023-03-03T07:43:36.391367+0000","last_active":"2023-03-03T07:43:37.379216+0000","last_peered":"2023-03-03T07:43:37.379216+0000","last_clean":"2023-03-03T07:43:37.379216+0000","last_became_active":"2023-03-03T07:43:36.388116+0000","last_became_peered":"2023-03-03T07:43:36.388116+0000","last_unstale":"2023-03-03T07:43:37.379216+0000","last_undegraded":"2023-03-03T07:43:37.379216+0000","last_fullsized":"2023-03-03T07:43:37.379216+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T19:18:26.044120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378275+0000","last_change":"2023-03-03T07:43:35.888682+0000","last_active":"2023-03-03T07:43:37.378275+0000","last_peered":"2023-03-03T07:43:37.378275+0000","last_clean":"2023-03-03T07:43:37.378275+0000","last_became_active":"2023-03-03T07:43:35.885672+0000","last_became_peered":"2023-03-03T07:43:35.885672+0000","last_unstale":"2023-03-03T07:43:37.378275+0000","last_undegraded":"2023-03-03T07:43:37.378275+0000","last_fullsized":"2023-03-03T07:43:37.378275+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:48:21.576840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379096+0000","last_change":"2023-03-03T07:43:36.387607+0000","last_active":"2023-03-03T07:43:37.379096+0000","last_peered":"2023-03-03T07:43:37.379096+0000","last_clean":"2023-03-03T07:43:37.379096+0000","last_became_active":"2023-03-03T07:43:36.386658+0000","last_became_peered":"2023-03-03T07:43:36.386658+0000","last_unstale":"2023-03-03T07:43:37.379096+0000","last_undegraded":"2023-03-03T07:43:37.379096+0000","last_fullsized":"2023-03-03T07:43:37.379096+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:05:06.641227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377419+0000","last_change":"2023-03-03T07:43:35.883415+0000","last_active":"2023-03-03T07:43:37.377419+0000","last_peered":"2023-03-03T07:43:37.377419+0000","last_clean":"2023-03-03T07:43:37.377419+0000","last_became_active":"2023-03-03T07:43:35.879803+0000","last_became_peered":"2023-03-03T07:43:35.879803+0000","last_unstale":"2023-03-03T07:43:37.377419+0000","last_undegraded":"2023-03-03T07:43:37.377419+0000","last_fullsized":"2023-03-03T07:43:37.377419+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:53:09.101814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381434+0000","last_change":"2023-03-03T07:43:36.393515+0000","last_active":"2023-03-03T07:43:37.381434+0000","last_peered":"2023-03-03T07:43:37.381434+0000","last_clean":"2023-03-03T07:43:37.381434+0000","last_became_active":"2023-03-03T07:43:36.386953+0000","last_became_peered":"2023-03-03T07:43:36.386953+0000","last_unstale":"2023-03-03T07:43:37.381434+0000","last_undegraded":"2023-03-03T07:43:37.381434+0000","last_fullsized":"2023-03-03T07:43:37.381434+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:26:22.884535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"8'97","reported_seq":143,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-03-03T07:43:36.365033+0000","last_change":"2023-03-03T07:43:24.771480+0000","last_active":"2023-03-03T07:43:36.365033+0000","last_peered":"2023-03-03T07:43:36.365033+0000","last_clean":"2023-03-03T07:43:36.365033+0000","last_became_active":"2023-03-03T07:43:24.770862+0000","last_became_peered":"2023-03-03T07:43:24.770862+0000","last_unstale":"2023-03-03T07:43:36.365033+0000","last_undegraded":"2023-03-03T07:43:36.365033+0000","last_fullsized":"2023-03-03T07:43:36.365033+0000","mapping_epoch":7,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":8,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:23.755169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:23.755169+0000","last_clean_scrub_stamp":"2023-03-03T07:43:23.755169+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:20:16.340417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-03-03T07:43:36.373715+0000","last_change":"2023-03-03T07:43:29.819791+0000","last_active":"2023-03-03T07:43:36.373715+0000","last_peered":"2023-03-03T07:43:36.373715+0000","last_clean":"2023-03-03T07:43:36.373715+0000","last_became_active":"2023-03-03T07:43:29.819125+0000","last_became_peered":"2023-03-03T07:43:29.819125+0000","last_unstale":"2023-03-03T07:43:36.373715+0000","last_undegraded":"2023-03-03T07:43:36.373715+0000","last_fullsized":"2023-03-03T07:43:36.373715+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_clean_scrub_stamp":"2023-03-03T07:43:28.794012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:48:46.625707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379126+0000","last_change":"2023-03-03T07:43:35.893902+0000","last_active":"2023-03-03T07:43:37.379126+0000","last_peered":"2023-03-03T07:43:37.379126+0000","last_clean":"2023-03-03T07:43:37.379126+0000","last_became_active":"2023-03-03T07:43:35.893653+0000","last_became_peered":"2023-03-03T07:43:35.893653+0000","last_unstale":"2023-03-03T07:43:37.379126+0000","last_undegraded":"2023-03-03T07:43:37.379126+0000","last_fullsized":"2023-03-03T07:43:37.379126+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T19:12:31.497654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379473+0000","last_change":"2023-03-03T07:43:36.391576+0000","last_active":"2023-03-03T07:43:37.379473+0000","last_peered":"2023-03-03T07:43:37.379473+0000","last_clean":"2023-03-03T07:43:37.379473+0000","last_became_active":"2023-03-03T07:43:36.388391+0000","last_became_peered":"2023-03-03T07:43:36.388391+0000","last_unstale":"2023-03-03T07:43:37.379473+0000","last_undegraded":"2023-03-03T07:43:37.379473+0000","last_fullsized":"2023-03-03T07:43:37.379473+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:44:38.954038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-03-03T07:43:36.365185+0000","last_change":"2023-03-03T07:43:29.821593+0000","last_active":"2023-03-03T07:43:36.365185+0000","last_peered":"2023-03-03T07:43:36.365185+0000","last_clean":"2023-03-03T07:43:36.365185+0000","last_became_active":"2023-03-03T07:43:29.821155+0000","last_became_peered":"2023-03-03T07:43:29.821155+0000","last_unstale":"2023-03-03T07:43:36.365185+0000","last_undegraded":"2023-03-03T07:43:36.365185+0000","last_fullsized":"2023-03-03T07:43:36.365185+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_clean_scrub_stamp":"2023-03-03T07:43:28.794012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:16:45.103665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378480+0000","last_change":"2023-03-03T07:43:35.890752+0000","last_active":"2023-03-03T07:43:37.378480+0000","last_peered":"2023-03-03T07:43:37.378480+0000","last_clean":"2023-03-03T07:43:37.378480+0000","last_became_active":"2023-03-03T07:43:35.888875+0000","last_became_peered":"2023-03-03T07:43:35.888875+0000","last_unstale":"2023-03-03T07:43:37.378480+0000","last_undegraded":"2023-03-03T07:43:37.378480+0000","last_fullsized":"2023-03-03T07:43:37.378480+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:08:43.703528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379368+0000","last_change":"2023-03-03T07:43:36.392018+0000","last_active":"2023-03-03T07:43:37.379368+0000","last_peered":"2023-03-03T07:43:37.379368+0000","last_clean":"2023-03-03T07:43:37.379368+0000","last_became_active":"2023-03-03T07:43:36.389351+0000","last_became_peered":"2023-03-03T07:43:36.389351+0000","last_unstale":"2023-03-03T07:43:37.379368+0000","last_undegraded":"2023-03-03T07:43:37.379368+0000","last_fullsized":"2023-03-03T07:43:37.379368+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:52:03.369684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-03-03T07:43:36.373450+0000","last_change":"2023-03-03T07:43:29.820869+0000","last_active":"2023-03-03T07:43:36.373450+0000","last_peered":"2023-03-03T07:43:36.373450+0000","last_clean":"2023-03-03T07:43:36.373450+0000","last_became_active":"2023-03-03T07:43:29.820454+0000","last_became_peered":"2023-03-03T07:43:29.820454+0000","last_unstale":"2023-03-03T07:43:36.373450+0000","last_undegraded":"2023-03-03T07:43:36.373450+0000","last_fullsized":"2023-03-03T07:43:36.373450+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_clean_scrub_stamp":"2023-03-03T07:43:28.794012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:06:02.760825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377296+0000","last_change":"2023-03-03T07:43:35.888736+0000","last_active":"2023-03-03T07:43:37.377296+0000","last_peered":"2023-03-03T07:43:37.377296+0000","last_clean":"2023-03-03T07:43:37.377296+0000","last_became_active":"2023-03-03T07:43:35.884537+0000","last_became_peered":"2023-03-03T07:43:35.884537+0000","last_unstale":"2023-03-03T07:43:37.377296+0000","last_undegraded":"2023-03-03T07:43:37.377296+0000","last_fullsized":"2023-03-03T07:43:37.377296+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:33:42.799055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381565+0000","last_change":"2023-03-03T07:43:36.393538+0000","last_active":"2023-03-03T07:43:37.381565+0000","last_peered":"2023-03-03T07:43:37.381565+0000","last_clean":"2023-03-03T07:43:37.381565+0000","last_became_active":"2023-03-03T07:43:36.389830+0000","last_became_peered":"2023-03-03T07:43:36.389830+0000","last_unstale":"2023-03-03T07:43:37.381565+0000","last_undegraded":"2023-03-03T07:43:37.381565+0000","last_fullsized":"2023-03-03T07:43:37.381565+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:55:45.795027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-03-03T07:43:36.373791+0000","last_change":"2023-03-03T07:43:29.821156+0000","last_active":"2023-03-03T07:43:36.373791+0000","last_peered":"2023-03-03T07:43:36.373791+0000","last_clean":"2023-03-03T07:43:36.373791+0000","last_became_active":"2023-03-03T07:43:29.820471+0000","last_became_peered":"2023-03-03T07:43:29.820471+0000","last_unstale":"2023-03-03T07:43:36.373791+0000","last_undegraded":"2023-03-03T07:43:36.373791+0000","last_fullsized":"2023-03-03T07:43:36.373791+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_clean_scrub_stamp":"2023-03-03T07:43:28.794012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:37:24.335449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379199+0000","last_change":"2023-03-03T07:43:35.895634+0000","last_active":"2023-03-03T07:43:37.379199+0000","last_peered":"2023-03-03T07:43:37.379199+0000","last_clean":"2023-03-03T07:43:37.379199+0000","last_became_active":"2023-03-03T07:43:35.895036+0000","last_became_peered":"2023-03-03T07:43:35.895036+0000","last_unstale":"2023-03-03T07:43:37.379199+0000","last_undegraded":"2023-03-03T07:43:37.379199+0000","last_fullsized":"2023-03-03T07:43:37.379199+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:49:24.082901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378991+0000","last_change":"2023-03-03T07:43:36.393263+0000","last_active":"2023-03-03T07:43:37.378991+0000","last_peered":"2023-03-03T07:43:37.378991+0000","last_clean":"2023-03-03T07:43:37.378991+0000","last_became_active":"2023-03-03T07:43:36.389601+0000","last_became_peered":"2023-03-03T07:43:36.389601+0000","last_unstale":"2023-03-03T07:43:37.378991+0000","last_undegraded":"2023-03-03T07:43:37.378991+0000","last_fullsized":"2023-03-03T07:43:37.378991+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:01:37.629716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381257+0000","last_change":"2023-03-03T07:43:35.895765+0000","last_active":"2023-03-03T07:43:37.381257+0000","last_peered":"2023-03-03T07:43:37.381257+0000","last_clean":"2023-03-03T07:43:37.381257+0000","last_became_active":"2023-03-03T07:43:35.894899+0000","last_became_peered":"2023-03-03T07:43:35.894899+0000","last_unstale":"2023-03-03T07:43:37.381257+0000","last_undegraded":"2023-03-03T07:43:37.381257+0000","last_fullsized":"2023-03-03T07:43:37.381257+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:26:15.189150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-03-03T07:43:36.372489+0000","last_change":"2023-03-03T07:43:29.822165+0000","last_active":"2023-03-03T07:43:36.372489+0000","last_peered":"2023-03-03T07:43:36.372489+0000","last_clean":"2023-03-03T07:43:36.372489+0000","last_became_active":"2023-03-03T07:43:29.821857+0000","last_became_peered":"2023-03-03T07:43:29.821857+0000","last_unstale":"2023-03-03T07:43:36.372489+0000","last_undegraded":"2023-03-03T07:43:36.372489+0000","last_fullsized":"2023-03-03T07:43:36.372489+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_clean_scrub_stamp":"2023-03-03T07:43:28.794012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:25:47.435749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378190+0000","last_change":"2023-03-03T07:43:36.383035+0000","last_active":"2023-03-03T07:43:37.378190+0000","last_peered":"2023-03-03T07:43:37.378190+0000","last_clean":"2023-03-03T07:43:37.378190+0000","last_became_active":"2023-03-03T07:43:36.380972+0000","last_became_peered":"2023-03-03T07:43:36.380972+0000","last_unstale":"2023-03-03T07:43:37.378190+0000","last_undegraded":"2023-03-03T07:43:37.378190+0000","last_fullsized":"2023-03-03T07:43:37.378190+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:48:16.722595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379574+0000","last_change":"2023-03-03T07:43:35.896322+0000","last_active":"2023-03-03T07:43:37.379574+0000","last_peered":"2023-03-03T07:43:37.379574+0000","last_clean":"2023-03-03T07:43:37.379574+0000","last_became_active":"2023-03-03T07:43:35.895238+0000","last_became_peered":"2023-03-03T07:43:35.895238+0000","last_unstale":"2023-03-03T07:43:37.379574+0000","last_undegraded":"2023-03-03T07:43:37.379574+0000","last_fullsized":"2023-03-03T07:43:37.379574+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:51:03.914235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-03-03T07:43:36.375587+0000","last_change":"2023-03-03T07:43:29.820875+0000","last_active":"2023-03-03T07:43:36.375587+0000","last_peered":"2023-03-03T07:43:36.375587+0000","last_clean":"2023-03-03T07:43:36.375587+0000","last_became_active":"2023-03-03T07:43:29.820497+0000","last_became_peered":"2023-03-03T07:43:29.820497+0000","last_unstale":"2023-03-03T07:43:36.375587+0000","last_undegraded":"2023-03-03T07:43:36.375587+0000","last_fullsized":"2023-03-03T07:43:36.375587+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_clean_scrub_stamp":"2023-03-03T07:43:28.794012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:47:10.778507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378313+0000","last_change":"2023-03-03T07:43:36.389829+0000","last_active":"2023-03-03T07:43:37.378313+0000","last_peered":"2023-03-03T07:43:37.378313+0000","last_clean":"2023-03-03T07:43:37.378313+0000","last_became_active":"2023-03-03T07:43:36.389575+0000","last_became_peered":"2023-03-03T07:43:36.389575+0000","last_unstale":"2023-03-03T07:43:37.378313+0000","last_undegraded":"2023-03-03T07:43:37.378313+0000","last_fullsized":"2023-03-03T07:43:37.378313+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:19:30.092333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"15'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.382039+0000","last_change":"2023-03-03T07:43:35.895805+0000","last_active":"2023-03-03T07:43:37.382039+0000","last_peered":"2023-03-03T07:43:37.382039+0000","last_clean":"2023-03-03T07:43:37.382039+0000","last_became_active":"2023-03-03T07:43:35.894950+0000","last_became_peered":"2023-03-03T07:43:35.894950+0000","last_unstale":"2023-03-03T07:43:37.382039+0000","last_undegraded":"2023-03-03T07:43:37.382039+0000","last_fullsized":"2023-03-03T07:43:37.382039+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T19:14:52.719580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":1,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-03-03T07:43:36.375541+0000","last_change":"2023-03-03T07:43:29.821552+0000","last_active":"2023-03-03T07:43:36.375541+0000","last_peered":"2023-03-03T07:43:36.375541+0000","last_clean":"2023-03-03T07:43:36.375541+0000","last_became_active":"2023-03-03T07:43:29.820710+0000","last_became_peered":"2023-03-03T07:43:29.820710+0000","last_unstale":"2023-03-03T07:43:36.375541+0000","last_undegraded":"2023-03-03T07:43:36.375541+0000","last_fullsized":"2023-03-03T07:43:36.375541+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_clean_scrub_stamp":"2023-03-03T07:43:28.794012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T19:28:41.224615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377588+0000","last_change":"2023-03-03T07:43:36.385134+0000","last_active":"2023-03-03T07:43:37.377588+0000","last_peered":"2023-03-03T07:43:37.377588+0000","last_clean":"2023-03-03T07:43:37.377588+0000","last_became_active":"2023-03-03T07:43:36.384452+0000","last_became_peered":"2023-03-03T07:43:36.384452+0000","last_unstale":"2023-03-03T07:43:37.377588+0000","last_undegraded":"2023-03-03T07:43:37.377588+0000","last_fullsized":"2023-03-03T07:43:37.377588+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:48:13.186580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.756044+0000","last_change":"2023-03-03T07:43:35.896493+0000","last_active":"2023-03-03T07:43:37.756044+0000","last_peered":"2023-03-03T07:43:37.756044+0000","last_clean":"2023-03-03T07:43:37.756044+0000","last_became_active":"2023-03-03T07:43:35.894837+0000","last_became_peered":"2023-03-03T07:43:35.894837+0000","last_unstale":"2023-03-03T07:43:37.756044+0000","last_undegraded":"2023-03-03T07:43:37.756044+0000","last_fullsized":"2023-03-03T07:43:37.756044+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:07:11.749055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":1,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-03-03T07:43:36.373487+0000","last_change":"2023-03-03T07:43:29.822831+0000","last_active":"2023-03-03T07:43:36.373487+0000","last_peered":"2023-03-03T07:43:36.373487+0000","last_clean":"2023-03-03T07:43:36.373487+0000","last_became_active":"2023-03-03T07:43:29.822123+0000","last_became_peered":"2023-03-03T07:43:29.822123+0000","last_unstale":"2023-03-03T07:43:36.373487+0000","last_undegraded":"2023-03-03T07:43:36.373487+0000","last_fullsized":"2023-03-03T07:43:36.373487+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_clean_scrub_stamp":"2023-03-03T07:43:28.794012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:22:14.249159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378057+0000","last_change":"2023-03-03T07:43:36.387892+0000","last_active":"2023-03-03T07:43:37.378057+0000","last_peered":"2023-03-03T07:43:37.378057+0000","last_clean":"2023-03-03T07:43:37.378057+0000","last_became_active":"2023-03-03T07:43:36.387614+0000","last_became_peered":"2023-03-03T07:43:36.387614+0000","last_unstale":"2023-03-03T07:43:37.378057+0000","last_undegraded":"2023-03-03T07:43:37.378057+0000","last_fullsized":"2023-03-03T07:43:37.378057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:27:19.301365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378039+0000","last_change":"2023-03-03T07:43:36.377558+0000","last_active":"2023-03-03T07:43:37.378039+0000","last_peered":"2023-03-03T07:43:37.378039+0000","last_clean":"2023-03-03T07:43:37.378039+0000","last_became_active":"2023-03-03T07:43:36.377338+0000","last_became_peered":"2023-03-03T07:43:36.377338+0000","last_unstale":"2023-03-03T07:43:37.378039+0000","last_undegraded":"2023-03-03T07:43:37.378039+0000","last_fullsized":"2023-03-03T07:43:37.378039+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:52:56.959518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"15'6","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379411+0000","last_change":"2023-03-03T07:43:35.895416+0000","last_active":"2023-03-03T07:43:37.379411+0000","last_peered":"2023-03-03T07:43:37.379411+0000","last_clean":"2023-03-03T07:43:37.379411+0000","last_became_active":"2023-03-03T07:43:35.895003+0000","last_became_peered":"2023-03-03T07:43:35.895003+0000","last_unstale":"2023-03-03T07:43:37.379411+0000","last_undegraded":"2023-03-03T07:43:37.379411+0000","last_fullsized":"2023-03-03T07:43:37.379411+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:01:35.747172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378917+0000","last_change":"2023-03-03T07:43:36.393271+0000","last_active":"2023-03-03T07:43:37.378917+0000","last_peered":"2023-03-03T07:43:37.378917+0000","last_clean":"2023-03-03T07:43:37.378917+0000","last_became_active":"2023-03-03T07:43:36.392090+0000","last_became_peered":"2023-03-03T07:43:36.392090+0000","last_unstale":"2023-03-03T07:43:37.378917+0000","last_undegraded":"2023-03-03T07:43:37.378917+0000","last_fullsized":"2023-03-03T07:43:37.378917+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:37:14.185390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"15'3","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379351+0000","last_change":"2023-03-03T07:43:35.895610+0000","last_active":"2023-03-03T07:43:37.379351+0000","last_peered":"2023-03-03T07:43:37.379351+0000","last_clean":"2023-03-03T07:43:37.379351+0000","last_became_active":"2023-03-03T07:43:35.894334+0000","last_became_peered":"2023-03-03T07:43:35.894334+0000","last_unstale":"2023-03-03T07:43:37.379351+0000","last_undegraded":"2023-03-03T07:43:37.379351+0000","last_fullsized":"2023-03-03T07:43:37.379351+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:05:19.182581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381310+0000","last_change":"2023-03-03T07:43:35.894489+0000","last_active":"2023-03-03T07:43:37.381310+0000","last_peered":"2023-03-03T07:43:37.381310+0000","last_clean":"2023-03-03T07:43:37.381310+0000","last_became_active":"2023-03-03T07:43:35.894246+0000","last_became_peered":"2023-03-03T07:43:35.894246+0000","last_unstale":"2023-03-03T07:43:37.381310+0000","last_undegraded":"2023-03-03T07:43:37.381310+0000","last_fullsized":"2023-03-03T07:43:37.381310+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:57:25.492548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377698+0000","last_change":"2023-03-03T07:43:36.382817+0000","last_active":"2023-03-03T07:43:37.377698+0000","last_peered":"2023-03-03T07:43:37.377698+0000","last_clean":"2023-03-03T07:43:37.377698+0000","last_became_active":"2023-03-03T07:43:36.381184+0000","last_became_peered":"2023-03-03T07:43:36.381184+0000","last_unstale":"2023-03-03T07:43:37.377698+0000","last_undegraded":"2023-03-03T07:43:37.377698+0000","last_fullsized":"2023-03-03T07:43:37.377698+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:48:21.525727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381814+0000","last_change":"2023-03-03T07:43:35.895790+0000","last_active":"2023-03-03T07:43:37.381814+0000","last_peered":"2023-03-03T07:43:37.381814+0000","last_clean":"2023-03-03T07:43:37.381814+0000","last_became_active":"2023-03-03T07:43:35.894635+0000","last_became_peered":"2023-03-03T07:43:35.894635+0000","last_unstale":"2023-03-03T07:43:37.381814+0000","last_undegraded":"2023-03-03T07:43:37.381814+0000","last_fullsized":"2023-03-03T07:43:37.381814+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:00:25.399331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377726+0000","last_change":"2023-03-03T07:43:36.385314+0000","last_active":"2023-03-03T07:43:37.377726+0000","last_peered":"2023-03-03T07:43:37.377726+0000","last_clean":"2023-03-03T07:43:37.377726+0000","last_became_active":"2023-03-03T07:43:36.384718+0000","last_became_peered":"2023-03-03T07:43:36.384718+0000","last_unstale":"2023-03-03T07:43:37.377726+0000","last_undegraded":"2023-03-03T07:43:37.377726+0000","last_fullsized":"2023-03-03T07:43:37.377726+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T19:26:37.184969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378596+0000","last_change":"2023-03-03T07:43:36.386105+0000","last_active":"2023-03-03T07:43:37.378596+0000","last_peered":"2023-03-03T07:43:37.378596+0000","last_clean":"2023-03-03T07:43:37.378596+0000","last_became_active":"2023-03-03T07:43:36.385731+0000","last_became_peered":"2023-03-03T07:43:36.385731+0000","last_unstale":"2023-03-03T07:43:37.378596+0000","last_undegraded":"2023-03-03T07:43:37.378596+0000","last_fullsized":"2023-03-03T07:43:37.378596+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T19:26:45.707634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377039+0000","last_change":"2023-03-03T07:43:35.885660+0000","last_active":"2023-03-03T07:43:37.377039+0000","last_peered":"2023-03-03T07:43:37.377039+0000","last_clean":"2023-03-03T07:43:37.377039+0000","last_became_active":"2023-03-03T07:43:35.883112+0000","last_became_peered":"2023-03-03T07:43:35.883112+0000","last_unstale":"2023-03-03T07:43:37.377039+0000","last_undegraded":"2023-03-03T07:43:37.377039+0000","last_fullsized":"2023-03-03T07:43:37.377039+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:00:22.463509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381401+0000","last_change":"2023-03-03T07:43:36.391839+0000","last_active":"2023-03-03T07:43:37.381401+0000","last_peered":"2023-03-03T07:43:37.381401+0000","last_clean":"2023-03-03T07:43:37.381401+0000","last_became_active":"2023-03-03T07:43:36.388296+0000","last_became_peered":"2023-03-03T07:43:36.388296+0000","last_unstale":"2023-03-03T07:43:37.381401+0000","last_undegraded":"2023-03-03T07:43:37.381401+0000","last_fullsized":"2023-03-03T07:43:37.381401+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:50:23.423175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377857+0000","last_change":"2023-03-03T07:43:35.888737+0000","last_active":"2023-03-03T07:43:37.377857+0000","last_peered":"2023-03-03T07:43:37.377857+0000","last_clean":"2023-03-03T07:43:37.377857+0000","last_became_active":"2023-03-03T07:43:35.886324+0000","last_became_peered":"2023-03-03T07:43:35.886324+0000","last_unstale":"2023-03-03T07:43:37.377857+0000","last_undegraded":"2023-03-03T07:43:37.377857+0000","last_fullsized":"2023-03-03T07:43:37.377857+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:17:39.088385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378888+0000","last_change":"2023-03-03T07:43:36.391334+0000","last_active":"2023-03-03T07:43:37.378888+0000","last_peered":"2023-03-03T07:43:37.378888+0000","last_clean":"2023-03-03T07:43:37.378888+0000","last_became_active":"2023-03-03T07:43:36.387583+0000","last_became_peered":"2023-03-03T07:43:36.387583+0000","last_unstale":"2023-03-03T07:43:37.378888+0000","last_undegraded":"2023-03-03T07:43:37.378888+0000","last_fullsized":"2023-03-03T07:43:37.378888+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:29:23.983350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378556+0000","last_change":"2023-03-03T07:43:35.888455+0000","last_active":"2023-03-03T07:43:37.378556+0000","last_peered":"2023-03-03T07:43:37.378556+0000","last_clean":"2023-03-03T07:43:37.378556+0000","last_became_active":"2023-03-03T07:43:35.888141+0000","last_became_peered":"2023-03-03T07:43:35.888141+0000","last_unstale":"2023-03-03T07:43:37.378556+0000","last_undegraded":"2023-03-03T07:43:37.378556+0000","last_fullsized":"2023-03-03T07:43:37.378556+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:16:28.849552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378309+0000","last_change":"2023-03-03T07:43:36.392205+0000","last_active":"2023-03-03T07:43:37.378309+0000","last_peered":"2023-03-03T07:43:37.378309+0000","last_clean":"2023-03-03T07:43:37.378309+0000","last_became_active":"2023-03-03T07:43:36.388128+0000","last_became_peered":"2023-03-03T07:43:36.388128+0000","last_unstale":"2023-03-03T07:43:37.378309+0000","last_undegraded":"2023-03-03T07:43:37.378309+0000","last_fullsized":"2023-03-03T07:43:37.378309+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:37:51.500144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378540+0000","last_change":"2023-03-03T07:43:35.893932+0000","last_active":"2023-03-03T07:43:37.378540+0000","last_peered":"2023-03-03T07:43:37.378540+0000","last_clean":"2023-03-03T07:43:37.378540+0000","last_became_active":"2023-03-03T07:43:35.893689+0000","last_became_peered":"2023-03-03T07:43:35.893689+0000","last_unstale":"2023-03-03T07:43:37.378540+0000","last_undegraded":"2023-03-03T07:43:37.378540+0000","last_fullsized":"2023-03-03T07:43:37.378540+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:26:49.876498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378002+0000","last_change":"2023-03-03T07:43:36.377538+0000","last_active":"2023-03-03T07:43:37.378002+0000","last_peered":"2023-03-03T07:43:37.378002+0000","last_clean":"2023-03-03T07:43:37.378002+0000","last_became_active":"2023-03-03T07:43:36.377279+0000","last_became_peered":"2023-03-03T07:43:36.377279+0000","last_unstale":"2023-03-03T07:43:37.378002+0000","last_undegraded":"2023-03-03T07:43:37.378002+0000","last_fullsized":"2023-03-03T07:43:37.378002+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:26:17.662598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379204+0000","last_change":"2023-03-03T07:43:35.893989+0000","last_active":"2023-03-03T07:43:37.379204+0000","last_peered":"2023-03-03T07:43:37.379204+0000","last_clean":"2023-03-03T07:43:37.379204+0000","last_became_active":"2023-03-03T07:43:35.893701+0000","last_became_peered":"2023-03-03T07:43:35.893701+0000","last_unstale":"2023-03-03T07:43:37.379204+0000","last_undegraded":"2023-03-03T07:43:37.379204+0000","last_fullsized":"2023-03-03T07:43:37.379204+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:59:24.744163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":1,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378705+0000","last_change":"2023-03-03T07:43:36.383356+0000","last_active":"2023-03-03T07:43:37.378705+0000","last_peered":"2023-03-03T07:43:37.378705+0000","last_clean":"2023-03-03T07:43:37.378705+0000","last_became_active":"2023-03-03T07:43:36.381546+0000","last_became_peered":"2023-03-03T07:43:36.381546+0000","last_unstale":"2023-03-03T07:43:37.378705+0000","last_undegraded":"2023-03-03T07:43:37.378705+0000","last_fullsized":"2023-03-03T07:43:37.378705+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:06:50.266644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"15'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379105+0000","last_change":"2023-03-03T07:43:35.894711+0000","last_active":"2023-03-03T07:43:37.379105+0000","last_peered":"2023-03-03T07:43:37.379105+0000","last_clean":"2023-03-03T07:43:37.379105+0000","last_became_active":"2023-03-03T07:43:35.893970+0000","last_became_peered":"2023-03-03T07:43:35.893970+0000","last_unstale":"2023-03-03T07:43:37.379105+0000","last_undegraded":"2023-03-03T07:43:37.379105+0000","last_fullsized":"2023-03-03T07:43:37.379105+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:17:16.461687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":1,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379601+0000","last_change":"2023-03-03T07:43:36.389431+0000","last_active":"2023-03-03T07:43:37.379601+0000","last_peered":"2023-03-03T07:43:37.379601+0000","last_clean":"2023-03-03T07:43:37.379601+0000","last_became_active":"2023-03-03T07:43:36.388088+0000","last_became_peered":"2023-03-03T07:43:36.388088+0000","last_unstale":"2023-03-03T07:43:37.379601+0000","last_undegraded":"2023-03-03T07:43:37.379601+0000","last_fullsized":"2023-03-03T07:43:37.379601+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:38:06.090984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381157+0000","last_change":"2023-03-03T07:43:35.896502+0000","last_active":"2023-03-03T07:43:37.381157+0000","last_peered":"2023-03-03T07:43:37.381157+0000","last_clean":"2023-03-03T07:43:37.381157+0000","last_became_active":"2023-03-03T07:43:35.896259+0000","last_became_peered":"2023-03-03T07:43:35.896259+0000","last_unstale":"2023-03-03T07:43:37.381157+0000","last_undegraded":"2023-03-03T07:43:37.381157+0000","last_fullsized":"2023-03-03T07:43:37.381157+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:16:57.833751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377310+0000","last_change":"2023-03-03T07:43:36.385037+0000","last_active":"2023-03-03T07:43:37.377310+0000","last_peered":"2023-03-03T07:43:37.377310+0000","last_clean":"2023-03-03T07:43:37.377310+0000","last_became_active":"2023-03-03T07:43:36.383754+0000","last_became_peered":"2023-03-03T07:43:36.383754+0000","last_unstale":"2023-03-03T07:43:37.377310+0000","last_undegraded":"2023-03-03T07:43:37.377310+0000","last_fullsized":"2023-03-03T07:43:37.377310+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:23:35.231949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381694+0000","last_change":"2023-03-03T07:43:35.895981+0000","last_active":"2023-03-03T07:43:37.381694+0000","last_peered":"2023-03-03T07:43:37.381694+0000","last_clean":"2023-03-03T07:43:37.381694+0000","last_became_active":"2023-03-03T07:43:35.895386+0000","last_became_peered":"2023-03-03T07:43:35.895386+0000","last_unstale":"2023-03-03T07:43:37.381694+0000","last_undegraded":"2023-03-03T07:43:37.381694+0000","last_fullsized":"2023-03-03T07:43:37.381694+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:55:52.173973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":1},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":32,"acting":32,"num_store_stats":1},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":8,"acting":8,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":1,"acting":1,"num_store_stats":1}],"osd_stats":[{"osd":0,"up_from":6,"seq":25769803783,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":1048576,"kb_used":9332,"kb_used_data":748,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":1039244,"statfs":{"total":1073741824,"available":1064185856,"internally_reserved":0,"allocated":765952,"data_stored":631325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-03T07:43:46.859 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-03T07:43:47.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.092+0000 7ffa113f2700 1 Processor -- start 2023-03-03T07:43:47.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.096+0000 7ffa113f2700 1 -- start start 2023-03-03T07:43:47.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.096+0000 7ffa113f2700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ffa0c126bf0 0x7ffa0c128fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:47.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.096+0000 7ffa113f2700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa0c071950 con 0x7ffa0c091410 2023-03-03T07:43:47.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.096+0000 7ffa113f2700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa0c071330 con 0x7ffa0c126bf0 2023-03-03T07:43:47.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.096+0000 7ffa0a7fc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ffa0c126bf0 0x7ffa0c128fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:47.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.096+0000 7ffa0a7fc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ffa0c126bf0 0x7ffa0c128fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35758/0 (socket says 172.21.15.57:35758) 2023-03-03T07:43:47.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.096+0000 7ffa0a7fc700 1 -- 172.21.15.57:0/3386755021 learned_addr learned my addr 172.21.15.57:0/3386755021 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:47.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.096+0000 7ffa0affd700 1 --1- 172.21.15.57:0/3386755021 >> v1:172.21.15.57:6789/0 conn(0x7ffa0c091410 0x7ffa0c0917e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56888/0 (socket says 172.21.15.57:56888) 2023-03-03T07:43:47.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.096+0000 7ffa0a7fc700 1 -- 172.21.15.57:0/3386755021 >> v1:172.21.15.57:6789/0 conn(0x7ffa0c091410 legacy=0x7ffa0c0917e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:47.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.096+0000 7ffa0a7fc700 1 -- 172.21.15.57:0/3386755021 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa0c071640 con 0x7ffa0c126bf0 2023-03-03T07:43:47.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.096+0000 7ffa0a7fc700 1 --2- 172.21.15.57:0/3386755021 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa0c126bf0 0x7ffa0c128fd0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ffa00009ad0 tx=0x7ffa00009de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fde8a6fe72b857a6 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:47.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.096+0000 7ffa09ffb700 1 -- 172.21.15.57:0/3386755021 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffa00004160 con 0x7ffa0c126bf0 2023-03-03T07:43:47.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.100+0000 7ffa09ffb700 1 -- 172.21.15.57:0/3386755021 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa000042c0 con 0x7ffa0c126bf0 2023-03-03T07:43:47.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.100+0000 7ffa09ffb700 1 -- 172.21.15.57:0/3386755021 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffa00004580 con 0x7ffa0c126bf0 2023-03-03T07:43:47.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.100+0000 7ffa113f2700 1 -- 172.21.15.57:0/3386755021 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa0c126bf0 msgr2=0x7ffa0c128fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:47.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.100+0000 7ffa113f2700 1 --2- 172.21.15.57:0/3386755021 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa0c126bf0 0x7ffa0c128fd0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ffa00009ad0 tx=0x7ffa00009de0 comp rx=0 tx=0).stop 2023-03-03T07:43:47.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.100+0000 7ffa113f2700 1 -- 172.21.15.57:0/3386755021 shutdown_connections 2023-03-03T07:43:47.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.100+0000 7ffa113f2700 1 --2- 172.21.15.57:0/3386755021 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa0c126bf0 0x7ffa0c128fd0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:47.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.100+0000 7ffa113f2700 1 -- 172.21.15.57:0/3386755021 >> 172.21.15.57:0/3386755021 conn(0x7ffa0c069f00 msgr2=0x7ffa0c06a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:47.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.100+0000 7ffa113f2700 1 -- 172.21.15.57:0/3386755021 shutdown_connections 2023-03-03T07:43:47.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.100+0000 7ffa113f2700 1 -- 172.21.15.57:0/3386755021 wait complete. 2023-03-03T07:43:47.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.104+0000 7ffa113f2700 1 Processor -- start 2023-03-03T07:43:47.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.104+0000 7ffa113f2700 1 -- start start 2023-03-03T07:43:47.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.104+0000 7ffa113f2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa0c091410 0x7ffa0c1194d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:47.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.104+0000 7ffa113f2700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0c120dd0 con 0x7ffa0c091410 2023-03-03T07:43:47.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.104+0000 7ffa0affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa0c091410 0x7ffa0c1194d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:47.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.104+0000 7ffa0affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa0c091410 0x7ffa0c1194d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35770/0 (socket says 172.21.15.57:35770) 2023-03-03T07:43:47.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.104+0000 7ffa0affd700 1 -- 172.21.15.57:0/3326697574 learned_addr learned my addr 172.21.15.57:0/3326697574 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:47.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.104+0000 7ffa0affd700 1 -- 172.21.15.57:0/3326697574 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa00009570 con 0x7ffa0c091410 2023-03-03T07:43:47.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.104+0000 7ffa0affd700 1 --2- 172.21.15.57:0/3326697574 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa0c091410 0x7ffa0c1194d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc00c480 tx=0x7ff9fc00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:47.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.108+0000 7ff9f37fe700 1 -- 172.21.15.57:0/3326697574 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff9fc005c00 con 0x7ffa0c091410 2023-03-03T07:43:47.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.108+0000 7ffa113f2700 1 -- 172.21.15.57:0/3326697574 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa0c094a70 con 0x7ffa0c091410 2023-03-03T07:43:47.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.108+0000 7ff9f37fe700 1 -- 172.21.15.57:0/3326697574 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9fc005d60 con 0x7ffa0c091410 2023-03-03T07:43:47.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.108+0000 7ff9f37fe700 1 -- 172.21.15.57:0/3326697574 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff9fc0070d0 con 0x7ffa0c091410 2023-03-03T07:43:47.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.108+0000 7ffa113f2700 1 -- 172.21.15.57:0/3326697574 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa0c0948e0 con 0x7ffa0c091410 2023-03-03T07:43:47.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.108+0000 7ffa113f2700 1 -- 172.21.15.57:0/3326697574 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa0c129510 con 0x7ffa0c091410 2023-03-03T07:43:47.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.108+0000 7ff9f37fe700 1 -- 172.21.15.57:0/3326697574 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42205+0+0 (secure 0 0 0) 0x7ff9fc019030 con 0x7ffa0c091410 2023-03-03T07:43:47.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.108+0000 7ff9f37fe700 1 --2- 172.21.15.57:0/3326697574 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7ff9f80347f0 0x7ff9f8036ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:47.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.108+0000 7ff9f37fe700 1 -- 172.21.15.57:0/3326697574 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2928+0+0 (secure 0 0 0) 0x7ff9fc045430 con 0x7ffa0c091410 2023-03-03T07:43:47.116 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.112+0000 7ffa0a7fc700 1 --2- 172.21.15.57:0/3326697574 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7ff9f80347f0 0x7ff9f8036ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:47.117 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.112+0000 7ffa0a7fc700 1 --2- 172.21.15.57:0/3326697574 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7ff9f80347f0 0x7ff9f8036ca0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ffa00009ad0 tx=0x7ffa00008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:47.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.116+0000 7ff9f37fe700 1 -- 172.21.15.57:0/3326697574 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff9fc011540 con 0x7ffa0c091410 2023-03-03T07:43:47.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.284+0000 7ffa113f2700 1 -- 172.21.15.57:0/3326697574 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffa0c04eff0 con 0x7ff9f80347f0 2023-03-03T07:43:47.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.292+0000 7ff9f37fe700 1 -- 172.21.15.57:0/3326697574 <== mgr.4099 v2:172.21.15.57:6808/28565 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+263639 (secure 0 0 0) 0x7ffa0c04eff0 con 0x7ff9f80347f0 2023-03-03T07:43:47.301 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-03T07:43:47.306 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.300+0000 7ffa113f2700 1 -- 172.21.15.57:0/3326697574 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7ff9f80347f0 msgr2=0x7ff9f8036ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:47.306 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.300+0000 7ffa113f2700 1 --2- 172.21.15.57:0/3326697574 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7ff9f80347f0 0x7ff9f8036ca0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ffa00009ad0 tx=0x7ffa00008030 comp rx=0 tx=0).stop 2023-03-03T07:43:47.306 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.300+0000 7ffa113f2700 1 -- 172.21.15.57:0/3326697574 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa0c091410 msgr2=0x7ffa0c1194d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:47.306 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.300+0000 7ffa113f2700 1 --2- 172.21.15.57:0/3326697574 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa0c091410 0x7ffa0c1194d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc00c480 tx=0x7ff9fc00c840 comp rx=0 tx=0).stop 2023-03-03T07:43:47.306 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.300+0000 7ffa113f2700 1 -- 172.21.15.57:0/3326697574 shutdown_connections 2023-03-03T07:43:47.306 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.300+0000 7ffa113f2700 1 --2- 172.21.15.57:0/3326697574 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7ff9f80347f0 0x7ff9f8036ca0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:47.306 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.300+0000 7ffa113f2700 1 --2- 172.21.15.57:0/3326697574 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa0c091410 0x7ffa0c1194d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:47.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.300+0000 7ffa113f2700 1 -- 172.21.15.57:0/3326697574 >> 172.21.15.57:0/3326697574 conn(0x7ffa0c069f00 msgr2=0x7ffa0c125260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:47.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.300+0000 7ffa113f2700 1 -- 172.21.15.57:0/3326697574 shutdown_connections 2023-03-03T07:43:47.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.300+0000 7ffa113f2700 1 -- 172.21.15.57:0/3326697574 wait complete. 2023-03-03T07:43:47.310 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-03-03T07:43:47.340 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-03-03T07:43:46.755265+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":24,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":182,"num_write_kb":1908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":136,"ondisk_log_size":136,"up":105,"acting":105,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":1048576,"kb_used":9332,"kb_used_data":748,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":1039244,"statfs":{"total":1073741824,"available":1064185856,"internally_reserved":0,"allocated":765952,"data_stored":631325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002798"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381705+0000","last_change":"2023-03-03T07:43:36.393637+0000","last_active":"2023-03-03T07:43:37.381705+0000","last_peered":"2023-03-03T07:43:37.381705+0000","last_clean":"2023-03-03T07:43:37.381705+0000","last_became_active":"2023-03-03T07:43:36.390086+0000","last_became_peered":"2023-03-03T07:43:36.390086+0000","last_unstale":"2023-03-03T07:43:37.381705+0000","last_undegraded":"2023-03-03T07:43:37.381705+0000","last_fullsized":"2023-03-03T07:43:37.381705+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:09:00.550158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378654+0000","last_change":"2023-03-03T07:43:36.387799+0000","last_active":"2023-03-03T07:43:37.378654+0000","last_peered":"2023-03-03T07:43:37.378654+0000","last_clean":"2023-03-03T07:43:37.378654+0000","last_became_active":"2023-03-03T07:43:36.386845+0000","last_became_peered":"2023-03-03T07:43:36.386845+0000","last_unstale":"2023-03-03T07:43:37.378654+0000","last_undegraded":"2023-03-03T07:43:37.378654+0000","last_fullsized":"2023-03-03T07:43:37.378654+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:17:33.673790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378497+0000","last_change":"2023-03-03T07:43:36.386277+0000","last_active":"2023-03-03T07:43:37.378497+0000","last_peered":"2023-03-03T07:43:37.378497+0000","last_clean":"2023-03-03T07:43:37.378497+0000","last_became_active":"2023-03-03T07:43:36.385656+0000","last_became_peered":"2023-03-03T07:43:36.385656+0000","last_unstale":"2023-03-03T07:43:37.378497+0000","last_undegraded":"2023-03-03T07:43:37.378497+0000","last_fullsized":"2023-03-03T07:43:37.378497+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:58:46.265569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378072+0000","last_change":"2023-03-03T07:43:36.386488+0000","last_active":"2023-03-03T07:43:37.378072+0000","last_peered":"2023-03-03T07:43:37.378072+0000","last_clean":"2023-03-03T07:43:37.378072+0000","last_became_active":"2023-03-03T07:43:36.385676+0000","last_became_peered":"2023-03-03T07:43:36.385676+0000","last_unstale":"2023-03-03T07:43:37.378072+0000","last_undegraded":"2023-03-03T07:43:37.378072+0000","last_fullsized":"2023-03-03T07:43:37.378072+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T19:10:46.103525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378425+0000","last_change":"2023-03-03T07:43:36.387609+0000","last_active":"2023-03-03T07:43:37.378425+0000","last_peered":"2023-03-03T07:43:37.378425+0000","last_clean":"2023-03-03T07:43:37.378425+0000","last_became_active":"2023-03-03T07:43:36.386787+0000","last_became_peered":"2023-03-03T07:43:36.386787+0000","last_unstale":"2023-03-03T07:43:37.378425+0000","last_undegraded":"2023-03-03T07:43:37.378425+0000","last_fullsized":"2023-03-03T07:43:37.378425+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:55:23.671272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377578+0000","last_change":"2023-03-03T07:43:36.391967+0000","last_active":"2023-03-03T07:43:37.377578+0000","last_peered":"2023-03-03T07:43:37.377578+0000","last_clean":"2023-03-03T07:43:37.377578+0000","last_became_active":"2023-03-03T07:43:36.388336+0000","last_became_peered":"2023-03-03T07:43:36.388336+0000","last_unstale":"2023-03-03T07:43:37.377578+0000","last_undegraded":"2023-03-03T07:43:37.377578+0000","last_fullsized":"2023-03-03T07:43:37.377578+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:00:15.483477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377385+0000","last_change":"2023-03-03T07:43:36.389899+0000","last_active":"2023-03-03T07:43:37.377385+0000","last_peered":"2023-03-03T07:43:37.377385+0000","last_clean":"2023-03-03T07:43:37.377385+0000","last_became_active":"2023-03-03T07:43:36.388351+0000","last_became_peered":"2023-03-03T07:43:36.388351+0000","last_unstale":"2023-03-03T07:43:37.377385+0000","last_undegraded":"2023-03-03T07:43:37.377385+0000","last_fullsized":"2023-03-03T07:43:37.377385+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:56:41.946658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377189+0000","last_change":"2023-03-03T07:43:36.384986+0000","last_active":"2023-03-03T07:43:37.377189+0000","last_peered":"2023-03-03T07:43:37.377189+0000","last_clean":"2023-03-03T07:43:37.377189+0000","last_became_active":"2023-03-03T07:43:36.383623+0000","last_became_peered":"2023-03-03T07:43:36.383623+0000","last_unstale":"2023-03-03T07:43:37.377189+0000","last_undegraded":"2023-03-03T07:43:37.377189+0000","last_fullsized":"2023-03-03T07:43:37.377189+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:23:12.419718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381830+0000","last_change":"2023-03-03T07:43:36.393726+0000","last_active":"2023-03-03T07:43:37.381830+0000","last_peered":"2023-03-03T07:43:37.381830+0000","last_clean":"2023-03-03T07:43:37.381830+0000","last_became_active":"2023-03-03T07:43:36.393246+0000","last_became_peered":"2023-03-03T07:43:36.393246+0000","last_unstale":"2023-03-03T07:43:37.381830+0000","last_undegraded":"2023-03-03T07:43:37.381830+0000","last_fullsized":"2023-03-03T07:43:37.381830+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:16:15.865411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378876+0000","last_change":"2023-03-03T07:43:36.386834+0000","last_active":"2023-03-03T07:43:37.378876+0000","last_peered":"2023-03-03T07:43:37.378876+0000","last_clean":"2023-03-03T07:43:37.378876+0000","last_became_active":"2023-03-03T07:43:36.386194+0000","last_became_peered":"2023-03-03T07:43:36.386194+0000","last_unstale":"2023-03-03T07:43:37.378876+0000","last_undegraded":"2023-03-03T07:43:37.378876+0000","last_fullsized":"2023-03-03T07:43:37.378876+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:55:32.472776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378632+0000","last_change":"2023-03-03T07:43:36.389629+0000","last_active":"2023-03-03T07:43:37.378632+0000","last_peered":"2023-03-03T07:43:37.378632+0000","last_clean":"2023-03-03T07:43:37.378632+0000","last_became_active":"2023-03-03T07:43:36.386514+0000","last_became_peered":"2023-03-03T07:43:36.386514+0000","last_unstale":"2023-03-03T07:43:37.378632+0000","last_undegraded":"2023-03-03T07:43:37.378632+0000","last_fullsized":"2023-03-03T07:43:37.378632+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:30:34.330114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378087+0000","last_change":"2023-03-03T07:43:36.392007+0000","last_active":"2023-03-03T07:43:37.378087+0000","last_peered":"2023-03-03T07:43:37.378087+0000","last_clean":"2023-03-03T07:43:37.378087+0000","last_became_active":"2023-03-03T07:43:36.387855+0000","last_became_peered":"2023-03-03T07:43:36.387855+0000","last_unstale":"2023-03-03T07:43:37.378087+0000","last_undegraded":"2023-03-03T07:43:37.378087+0000","last_fullsized":"2023-03-03T07:43:37.378087+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:36:55.997614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378670+0000","last_change":"2023-03-03T07:43:36.391658+0000","last_active":"2023-03-03T07:43:37.378670+0000","last_peered":"2023-03-03T07:43:37.378670+0000","last_clean":"2023-03-03T07:43:37.378670+0000","last_became_active":"2023-03-03T07:43:36.390126+0000","last_became_peered":"2023-03-03T07:43:36.390126+0000","last_unstale":"2023-03-03T07:43:37.378670+0000","last_undegraded":"2023-03-03T07:43:37.378670+0000","last_fullsized":"2023-03-03T07:43:37.378670+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:32:20.715403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377774+0000","last_change":"2023-03-03T07:43:36.381795+0000","last_active":"2023-03-03T07:43:37.377774+0000","last_peered":"2023-03-03T07:43:37.377774+0000","last_clean":"2023-03-03T07:43:37.377774+0000","last_became_active":"2023-03-03T07:43:36.380678+0000","last_became_peered":"2023-03-03T07:43:36.380678+0000","last_unstale":"2023-03-03T07:43:37.377774+0000","last_undegraded":"2023-03-03T07:43:37.377774+0000","last_fullsized":"2023-03-03T07:43:37.377774+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:49:53.962269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377318+0000","last_change":"2023-03-03T07:43:36.381452+0000","last_active":"2023-03-03T07:43:37.377318+0000","last_peered":"2023-03-03T07:43:37.377318+0000","last_clean":"2023-03-03T07:43:37.377318+0000","last_became_active":"2023-03-03T07:43:36.380631+0000","last_became_peered":"2023-03-03T07:43:36.380631+0000","last_unstale":"2023-03-03T07:43:37.377318+0000","last_undegraded":"2023-03-03T07:43:37.377318+0000","last_fullsized":"2023-03-03T07:43:37.377318+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:35:31.851815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378787+0000","last_change":"2023-03-03T07:43:36.386485+0000","last_active":"2023-03-03T07:43:37.378787+0000","last_peered":"2023-03-03T07:43:37.378787+0000","last_clean":"2023-03-03T07:43:37.378787+0000","last_became_active":"2023-03-03T07:43:36.385872+0000","last_became_peered":"2023-03-03T07:43:36.385872+0000","last_unstale":"2023-03-03T07:43:37.378787+0000","last_undegraded":"2023-03-03T07:43:37.378787+0000","last_fullsized":"2023-03-03T07:43:37.378787+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:40:02.564993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381949+0000","last_change":"2023-03-03T07:43:36.393749+0000","last_active":"2023-03-03T07:43:37.381949+0000","last_peered":"2023-03-03T07:43:37.381949+0000","last_clean":"2023-03-03T07:43:37.381949+0000","last_became_active":"2023-03-03T07:43:36.393288+0000","last_became_peered":"2023-03-03T07:43:36.393288+0000","last_unstale":"2023-03-03T07:43:37.381949+0000","last_undegraded":"2023-03-03T07:43:37.381949+0000","last_fullsized":"2023-03-03T07:43:37.381949+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:17:21.911716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379562+0000","last_change":"2023-03-03T07:43:36.391355+0000","last_active":"2023-03-03T07:43:37.379562+0000","last_peered":"2023-03-03T07:43:37.379562+0000","last_clean":"2023-03-03T07:43:37.379562+0000","last_became_active":"2023-03-03T07:43:36.387820+0000","last_became_peered":"2023-03-03T07:43:36.387820+0000","last_unstale":"2023-03-03T07:43:37.379562+0000","last_undegraded":"2023-03-03T07:43:37.379562+0000","last_fullsized":"2023-03-03T07:43:37.379562+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:22:59.608795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378766+0000","last_change":"2023-03-03T07:43:36.390057+0000","last_active":"2023-03-03T07:43:37.378766+0000","last_peered":"2023-03-03T07:43:37.378766+0000","last_clean":"2023-03-03T07:43:37.378766+0000","last_became_active":"2023-03-03T07:43:36.386741+0000","last_became_peered":"2023-03-03T07:43:36.386741+0000","last_unstale":"2023-03-03T07:43:37.378766+0000","last_undegraded":"2023-03-03T07:43:37.378766+0000","last_fullsized":"2023-03-03T07:43:37.378766+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:40:12.577170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378610+0000","last_change":"2023-03-03T07:43:36.393152+0000","last_active":"2023-03-03T07:43:37.378610+0000","last_peered":"2023-03-03T07:43:37.378610+0000","last_clean":"2023-03-03T07:43:37.378610+0000","last_became_active":"2023-03-03T07:43:36.388370+0000","last_became_peered":"2023-03-03T07:43:36.388370+0000","last_unstale":"2023-03-03T07:43:37.378610+0000","last_undegraded":"2023-03-03T07:43:37.378610+0000","last_fullsized":"2023-03-03T07:43:37.378610+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:52:19.250036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378810+0000","last_change":"2023-03-03T07:43:36.391466+0000","last_active":"2023-03-03T07:43:37.378810+0000","last_peered":"2023-03-03T07:43:37.378810+0000","last_clean":"2023-03-03T07:43:37.378810+0000","last_became_active":"2023-03-03T07:43:36.389987+0000","last_became_peered":"2023-03-03T07:43:36.389987+0000","last_unstale":"2023-03-03T07:43:37.378810+0000","last_undegraded":"2023-03-03T07:43:37.378810+0000","last_fullsized":"2023-03-03T07:43:37.378810+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:06:52.630210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377996+0000","last_change":"2023-03-03T07:43:36.383091+0000","last_active":"2023-03-03T07:43:37.377996+0000","last_peered":"2023-03-03T07:43:37.377996+0000","last_clean":"2023-03-03T07:43:37.377996+0000","last_became_active":"2023-03-03T07:43:36.380994+0000","last_became_peered":"2023-03-03T07:43:36.380994+0000","last_unstale":"2023-03-03T07:43:37.377996+0000","last_undegraded":"2023-03-03T07:43:37.377996+0000","last_fullsized":"2023-03-03T07:43:37.377996+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:18:41.788833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377524+0000","last_change":"2023-03-03T07:43:36.381681+0000","last_active":"2023-03-03T07:43:37.377524+0000","last_peered":"2023-03-03T07:43:37.377524+0000","last_clean":"2023-03-03T07:43:37.377524+0000","last_became_active":"2023-03-03T07:43:36.380651+0000","last_became_peered":"2023-03-03T07:43:36.380651+0000","last_unstale":"2023-03-03T07:43:37.377524+0000","last_undegraded":"2023-03-03T07:43:37.377524+0000","last_fullsized":"2023-03-03T07:43:37.377524+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:54:39.635086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377877+0000","last_change":"2023-03-03T07:43:36.387612+0000","last_active":"2023-03-03T07:43:37.377877+0000","last_peered":"2023-03-03T07:43:37.377877+0000","last_clean":"2023-03-03T07:43:37.377877+0000","last_became_active":"2023-03-03T07:43:36.386495+0000","last_became_peered":"2023-03-03T07:43:36.386495+0000","last_unstale":"2023-03-03T07:43:37.377877+0000","last_undegraded":"2023-03-03T07:43:37.377877+0000","last_fullsized":"2023-03-03T07:43:37.377877+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:32:02.438980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378481+0000","last_change":"2023-03-03T07:43:36.393652+0000","last_active":"2023-03-03T07:43:37.378481+0000","last_peered":"2023-03-03T07:43:37.378481+0000","last_clean":"2023-03-03T07:43:37.378481+0000","last_became_active":"2023-03-03T07:43:36.392133+0000","last_became_peered":"2023-03-03T07:43:36.392133+0000","last_unstale":"2023-03-03T07:43:37.378481+0000","last_undegraded":"2023-03-03T07:43:37.378481+0000","last_fullsized":"2023-03-03T07:43:37.378481+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:11:04.212221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381267+0000","last_change":"2023-03-03T07:43:36.391612+0000","last_active":"2023-03-03T07:43:37.381267+0000","last_peered":"2023-03-03T07:43:37.381267+0000","last_clean":"2023-03-03T07:43:37.381267+0000","last_became_active":"2023-03-03T07:43:36.388016+0000","last_became_peered":"2023-03-03T07:43:36.388016+0000","last_unstale":"2023-03-03T07:43:37.381267+0000","last_undegraded":"2023-03-03T07:43:37.381267+0000","last_fullsized":"2023-03-03T07:43:37.381267+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:57:04.070413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381222+0000","last_change":"2023-03-03T07:43:36.391717+0000","last_active":"2023-03-03T07:43:37.381222+0000","last_peered":"2023-03-03T07:43:37.381222+0000","last_clean":"2023-03-03T07:43:37.381222+0000","last_became_active":"2023-03-03T07:43:36.389768+0000","last_became_peered":"2023-03-03T07:43:36.389768+0000","last_unstale":"2023-03-03T07:43:37.381222+0000","last_undegraded":"2023-03-03T07:43:37.381222+0000","last_fullsized":"2023-03-03T07:43:37.381222+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:55:53.276950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379612+0000","last_change":"2023-03-03T07:43:36.393425+0000","last_active":"2023-03-03T07:43:37.379612+0000","last_peered":"2023-03-03T07:43:37.379612+0000","last_clean":"2023-03-03T07:43:37.379612+0000","last_became_active":"2023-03-03T07:43:36.391732+0000","last_became_peered":"2023-03-03T07:43:36.391732+0000","last_unstale":"2023-03-03T07:43:37.379612+0000","last_undegraded":"2023-03-03T07:43:37.379612+0000","last_fullsized":"2023-03-03T07:43:37.379612+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:45:17.493745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379072+0000","last_change":"2023-03-03T07:43:36.391823+0000","last_active":"2023-03-03T07:43:37.379072+0000","last_peered":"2023-03-03T07:43:37.379072+0000","last_clean":"2023-03-03T07:43:37.379072+0000","last_became_active":"2023-03-03T07:43:36.390288+0000","last_became_peered":"2023-03-03T07:43:36.390288+0000","last_unstale":"2023-03-03T07:43:37.379072+0000","last_undegraded":"2023-03-03T07:43:37.379072+0000","last_fullsized":"2023-03-03T07:43:37.379072+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:01:41.404103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378369+0000","last_change":"2023-03-03T07:43:36.383274+0000","last_active":"2023-03-03T07:43:37.378369+0000","last_peered":"2023-03-03T07:43:37.378369+0000","last_clean":"2023-03-03T07:43:37.378369+0000","last_became_active":"2023-03-03T07:43:36.381293+0000","last_became_peered":"2023-03-03T07:43:36.381293+0000","last_unstale":"2023-03-03T07:43:37.378369+0000","last_undegraded":"2023-03-03T07:43:37.378369+0000","last_fullsized":"2023-03-03T07:43:37.378369+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:27:20.763746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377615+0000","last_change":"2023-03-03T07:43:36.382637+0000","last_active":"2023-03-03T07:43:37.377615+0000","last_peered":"2023-03-03T07:43:37.377615+0000","last_clean":"2023-03-03T07:43:37.377615+0000","last_became_active":"2023-03-03T07:43:36.380941+0000","last_became_peered":"2023-03-03T07:43:36.380941+0000","last_unstale":"2023-03-03T07:43:37.377615+0000","last_undegraded":"2023-03-03T07:43:37.377615+0000","last_fullsized":"2023-03-03T07:43:37.377615+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:44:54.128297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377722+0000","last_change":"2023-03-03T07:43:36.385403+0000","last_active":"2023-03-03T07:43:37.377722+0000","last_peered":"2023-03-03T07:43:37.377722+0000","last_clean":"2023-03-03T07:43:37.377722+0000","last_became_active":"2023-03-03T07:43:36.384809+0000","last_became_peered":"2023-03-03T07:43:36.384809+0000","last_unstale":"2023-03-03T07:43:37.377722+0000","last_undegraded":"2023-03-03T07:43:37.377722+0000","last_fullsized":"2023-03-03T07:43:37.377722+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:40:13.258572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379386+0000","last_change":"2023-03-03T07:43:36.393487+0000","last_active":"2023-03-03T07:43:37.379386+0000","last_peered":"2023-03-03T07:43:37.379386+0000","last_clean":"2023-03-03T07:43:37.379386+0000","last_became_active":"2023-03-03T07:43:36.391768+0000","last_became_peered":"2023-03-03T07:43:36.391768+0000","last_unstale":"2023-03-03T07:43:37.379386+0000","last_undegraded":"2023-03-03T07:43:37.379386+0000","last_fullsized":"2023-03-03T07:43:37.379386+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:06:47.610243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378943+0000","last_change":"2023-03-03T07:43:35.895264+0000","last_active":"2023-03-03T07:43:37.378943+0000","last_peered":"2023-03-03T07:43:37.378943+0000","last_clean":"2023-03-03T07:43:37.378943+0000","last_became_active":"2023-03-03T07:43:35.894159+0000","last_became_peered":"2023-03-03T07:43:35.894159+0000","last_unstale":"2023-03-03T07:43:37.378943+0000","last_undegraded":"2023-03-03T07:43:37.378943+0000","last_fullsized":"2023-03-03T07:43:37.378943+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:51:45.982631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378998+0000","last_change":"2023-03-03T07:43:36.390239+0000","last_active":"2023-03-03T07:43:37.378998+0000","last_peered":"2023-03-03T07:43:37.378998+0000","last_clean":"2023-03-03T07:43:37.378998+0000","last_became_active":"2023-03-03T07:43:36.387807+0000","last_became_peered":"2023-03-03T07:43:36.387807+0000","last_unstale":"2023-03-03T07:43:37.378998+0000","last_undegraded":"2023-03-03T07:43:37.378998+0000","last_fullsized":"2023-03-03T07:43:37.378998+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:03:09.938807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378723+0000","last_change":"2023-03-03T07:43:35.888766+0000","last_active":"2023-03-03T07:43:37.378723+0000","last_peered":"2023-03-03T07:43:37.378723+0000","last_clean":"2023-03-03T07:43:37.378723+0000","last_became_active":"2023-03-03T07:43:35.888475+0000","last_became_peered":"2023-03-03T07:43:35.888475+0000","last_unstale":"2023-03-03T07:43:37.378723+0000","last_undegraded":"2023-03-03T07:43:37.378723+0000","last_fullsized":"2023-03-03T07:43:37.378723+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:38:06.266060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381468+0000","last_change":"2023-03-03T07:43:36.392191+0000","last_active":"2023-03-03T07:43:37.381468+0000","last_peered":"2023-03-03T07:43:37.381468+0000","last_clean":"2023-03-03T07:43:37.381468+0000","last_became_active":"2023-03-03T07:43:36.391967+0000","last_became_peered":"2023-03-03T07:43:36.391967+0000","last_unstale":"2023-03-03T07:43:37.381468+0000","last_undegraded":"2023-03-03T07:43:37.381468+0000","last_fullsized":"2023-03-03T07:43:37.381468+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:05:12.083235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378253+0000","last_change":"2023-03-03T07:43:35.877502+0000","last_active":"2023-03-03T07:43:37.378253+0000","last_peered":"2023-03-03T07:43:37.378253+0000","last_clean":"2023-03-03T07:43:37.378253+0000","last_became_active":"2023-03-03T07:43:35.876095+0000","last_became_peered":"2023-03-03T07:43:35.876095+0000","last_unstale":"2023-03-03T07:43:37.378253+0000","last_undegraded":"2023-03-03T07:43:37.378253+0000","last_fullsized":"2023-03-03T07:43:37.378253+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:04:51.085090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381278+0000","last_change":"2023-03-03T07:43:36.388187+0000","last_active":"2023-03-03T07:43:37.381278+0000","last_peered":"2023-03-03T07:43:37.381278+0000","last_clean":"2023-03-03T07:43:37.381278+0000","last_became_active":"2023-03-03T07:43:36.385750+0000","last_became_peered":"2023-03-03T07:43:36.385750+0000","last_unstale":"2023-03-03T07:43:37.381278+0000","last_undegraded":"2023-03-03T07:43:37.381278+0000","last_fullsized":"2023-03-03T07:43:37.381278+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:53:04.087750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"15'8","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377423+0000","last_change":"2023-03-03T07:43:35.885608+0000","last_active":"2023-03-03T07:43:37.377423+0000","last_peered":"2023-03-03T07:43:37.377423+0000","last_clean":"2023-03-03T07:43:37.377423+0000","last_became_active":"2023-03-03T07:43:35.882827+0000","last_became_peered":"2023-03-03T07:43:35.882827+0000","last_unstale":"2023-03-03T07:43:37.377423+0000","last_undegraded":"2023-03-03T07:43:37.377423+0000","last_fullsized":"2023-03-03T07:43:37.377423+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:10:08.916806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381936+0000","last_change":"2023-03-03T07:43:35.895617+0000","last_active":"2023-03-03T07:43:37.381936+0000","last_peered":"2023-03-03T07:43:37.381936+0000","last_clean":"2023-03-03T07:43:37.381936+0000","last_became_active":"2023-03-03T07:43:35.894656+0000","last_became_peered":"2023-03-03T07:43:35.894656+0000","last_unstale":"2023-03-03T07:43:37.381936+0000","last_undegraded":"2023-03-03T07:43:37.381936+0000","last_fullsized":"2023-03-03T07:43:37.381936+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:16:23.316589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":1,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377586+0000","last_change":"2023-03-03T07:43:36.385247+0000","last_active":"2023-03-03T07:43:37.377586+0000","last_peered":"2023-03-03T07:43:37.377586+0000","last_clean":"2023-03-03T07:43:37.377586+0000","last_became_active":"2023-03-03T07:43:36.384566+0000","last_became_peered":"2023-03-03T07:43:36.384566+0000","last_unstale":"2023-03-03T07:43:37.377586+0000","last_undegraded":"2023-03-03T07:43:37.377586+0000","last_fullsized":"2023-03-03T07:43:37.377586+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:13:56.887766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381435+0000","last_change":"2023-03-03T07:43:35.896637+0000","last_active":"2023-03-03T07:43:37.381435+0000","last_peered":"2023-03-03T07:43:37.381435+0000","last_clean":"2023-03-03T07:43:37.381435+0000","last_became_active":"2023-03-03T07:43:35.896121+0000","last_became_peered":"2023-03-03T07:43:35.896121+0000","last_unstale":"2023-03-03T07:43:37.381435+0000","last_undegraded":"2023-03-03T07:43:37.381435+0000","last_fullsized":"2023-03-03T07:43:37.381435+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:48:03.998157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":1,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377802+0000","last_change":"2023-03-03T07:43:36.382904+0000","last_active":"2023-03-03T07:43:37.377802+0000","last_peered":"2023-03-03T07:43:37.377802+0000","last_clean":"2023-03-03T07:43:37.377802+0000","last_became_active":"2023-03-03T07:43:36.382660+0000","last_became_peered":"2023-03-03T07:43:36.382660+0000","last_unstale":"2023-03-03T07:43:37.377802+0000","last_undegraded":"2023-03-03T07:43:37.377802+0000","last_fullsized":"2023-03-03T07:43:37.377802+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:08:38.514550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379594+0000","last_change":"2023-03-03T07:43:35.895808+0000","last_active":"2023-03-03T07:43:37.379594+0000","last_peered":"2023-03-03T07:43:37.379594+0000","last_clean":"2023-03-03T07:43:37.379594+0000","last_became_active":"2023-03-03T07:43:35.895529+0000","last_became_peered":"2023-03-03T07:43:35.895529+0000","last_unstale":"2023-03-03T07:43:37.379594+0000","last_undegraded":"2023-03-03T07:43:37.379594+0000","last_fullsized":"2023-03-03T07:43:37.379594+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:42:17.118297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":1,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379159+0000","last_change":"2023-03-03T07:43:36.392148+0000","last_active":"2023-03-03T07:43:37.379159+0000","last_peered":"2023-03-03T07:43:37.379159+0000","last_clean":"2023-03-03T07:43:37.379159+0000","last_became_active":"2023-03-03T07:43:36.391440+0000","last_became_peered":"2023-03-03T07:43:36.391440+0000","last_unstale":"2023-03-03T07:43:37.379159+0000","last_undegraded":"2023-03-03T07:43:37.379159+0000","last_fullsized":"2023-03-03T07:43:37.379159+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:17:49.134435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379489+0000","last_change":"2023-03-03T07:43:35.895938+0000","last_active":"2023-03-03T07:43:37.379489+0000","last_peered":"2023-03-03T07:43:37.379489+0000","last_clean":"2023-03-03T07:43:37.379489+0000","last_became_active":"2023-03-03T07:43:35.895196+0000","last_became_peered":"2023-03-03T07:43:35.895196+0000","last_unstale":"2023-03-03T07:43:37.379489+0000","last_undegraded":"2023-03-03T07:43:37.379489+0000","last_fullsized":"2023-03-03T07:43:37.379489+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:09:18.543009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378191+0000","last_change":"2023-03-03T07:43:36.391749+0000","last_active":"2023-03-03T07:43:37.378191+0000","last_peered":"2023-03-03T07:43:37.378191+0000","last_clean":"2023-03-03T07:43:37.378191+0000","last_became_active":"2023-03-03T07:43:36.389888+0000","last_became_peered":"2023-03-03T07:43:36.389888+0000","last_unstale":"2023-03-03T07:43:37.378191+0000","last_undegraded":"2023-03-03T07:43:37.378191+0000","last_fullsized":"2023-03-03T07:43:37.378191+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:06:24.364753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"15'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379694+0000","last_change":"2023-03-03T07:43:35.895961+0000","last_active":"2023-03-03T07:43:37.379694+0000","last_peered":"2023-03-03T07:43:37.379694+0000","last_clean":"2023-03-03T07:43:37.379694+0000","last_became_active":"2023-03-03T07:43:35.894409+0000","last_became_peered":"2023-03-03T07:43:35.894409+0000","last_unstale":"2023-03-03T07:43:37.379694+0000","last_undegraded":"2023-03-03T07:43:37.379694+0000","last_fullsized":"2023-03-03T07:43:37.379694+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:34:04.674852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":1,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378795+0000","last_change":"2023-03-03T07:43:36.393323+0000","last_active":"2023-03-03T07:43:37.378795+0000","last_peered":"2023-03-03T07:43:37.378795+0000","last_clean":"2023-03-03T07:43:37.378795+0000","last_became_active":"2023-03-03T07:43:36.391375+0000","last_became_peered":"2023-03-03T07:43:36.391375+0000","last_unstale":"2023-03-03T07:43:37.378795+0000","last_undegraded":"2023-03-03T07:43:37.378795+0000","last_fullsized":"2023-03-03T07:43:37.378795+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:50:37.609201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378961+0000","last_change":"2023-03-03T07:43:35.894763+0000","last_active":"2023-03-03T07:43:37.378961+0000","last_peered":"2023-03-03T07:43:37.378961+0000","last_clean":"2023-03-03T07:43:37.378961+0000","last_became_active":"2023-03-03T07:43:35.894469+0000","last_became_peered":"2023-03-03T07:43:35.894469+0000","last_unstale":"2023-03-03T07:43:37.378961+0000","last_undegraded":"2023-03-03T07:43:37.378961+0000","last_fullsized":"2023-03-03T07:43:37.378961+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:36:02.233356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379216+0000","last_change":"2023-03-03T07:43:36.391367+0000","last_active":"2023-03-03T07:43:37.379216+0000","last_peered":"2023-03-03T07:43:37.379216+0000","last_clean":"2023-03-03T07:43:37.379216+0000","last_became_active":"2023-03-03T07:43:36.388116+0000","last_became_peered":"2023-03-03T07:43:36.388116+0000","last_unstale":"2023-03-03T07:43:37.379216+0000","last_undegraded":"2023-03-03T07:43:37.379216+0000","last_fullsized":"2023-03-03T07:43:37.379216+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T19:18:26.044120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378275+0000","last_change":"2023-03-03T07:43:35.888682+0000","last_active":"2023-03-03T07:43:37.378275+0000","last_peered":"2023-03-03T07:43:37.378275+0000","last_clean":"2023-03-03T07:43:37.378275+0000","last_became_active":"2023-03-03T07:43:35.885672+0000","last_became_peered":"2023-03-03T07:43:35.885672+0000","last_unstale":"2023-03-03T07:43:37.378275+0000","last_undegraded":"2023-03-03T07:43:37.378275+0000","last_fullsized":"2023-03-03T07:43:37.378275+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:48:21.576840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379096+0000","last_change":"2023-03-03T07:43:36.387607+0000","last_active":"2023-03-03T07:43:37.379096+0000","last_peered":"2023-03-03T07:43:37.379096+0000","last_clean":"2023-03-03T07:43:37.379096+0000","last_became_active":"2023-03-03T07:43:36.386658+0000","last_became_peered":"2023-03-03T07:43:36.386658+0000","last_unstale":"2023-03-03T07:43:37.379096+0000","last_undegraded":"2023-03-03T07:43:37.379096+0000","last_fullsized":"2023-03-03T07:43:37.379096+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:05:06.641227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377419+0000","last_change":"2023-03-03T07:43:35.883415+0000","last_active":"2023-03-03T07:43:37.377419+0000","last_peered":"2023-03-03T07:43:37.377419+0000","last_clean":"2023-03-03T07:43:37.377419+0000","last_became_active":"2023-03-03T07:43:35.879803+0000","last_became_peered":"2023-03-03T07:43:35.879803+0000","last_unstale":"2023-03-03T07:43:37.377419+0000","last_undegraded":"2023-03-03T07:43:37.377419+0000","last_fullsized":"2023-03-03T07:43:37.377419+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:53:09.101814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381434+0000","last_change":"2023-03-03T07:43:36.393515+0000","last_active":"2023-03-03T07:43:37.381434+0000","last_peered":"2023-03-03T07:43:37.381434+0000","last_clean":"2023-03-03T07:43:37.381434+0000","last_became_active":"2023-03-03T07:43:36.386953+0000","last_became_peered":"2023-03-03T07:43:36.386953+0000","last_unstale":"2023-03-03T07:43:37.381434+0000","last_undegraded":"2023-03-03T07:43:37.381434+0000","last_fullsized":"2023-03-03T07:43:37.381434+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:26:22.884535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"8'97","reported_seq":143,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-03-03T07:43:36.365033+0000","last_change":"2023-03-03T07:43:24.771480+0000","last_active":"2023-03-03T07:43:36.365033+0000","last_peered":"2023-03-03T07:43:36.365033+0000","last_clean":"2023-03-03T07:43:36.365033+0000","last_became_active":"2023-03-03T07:43:24.770862+0000","last_became_peered":"2023-03-03T07:43:24.770862+0000","last_unstale":"2023-03-03T07:43:36.365033+0000","last_undegraded":"2023-03-03T07:43:36.365033+0000","last_fullsized":"2023-03-03T07:43:36.365033+0000","mapping_epoch":7,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":8,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:23.755169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:23.755169+0000","last_clean_scrub_stamp":"2023-03-03T07:43:23.755169+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:20:16.340417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-03-03T07:43:36.373715+0000","last_change":"2023-03-03T07:43:29.819791+0000","last_active":"2023-03-03T07:43:36.373715+0000","last_peered":"2023-03-03T07:43:36.373715+0000","last_clean":"2023-03-03T07:43:36.373715+0000","last_became_active":"2023-03-03T07:43:29.819125+0000","last_became_peered":"2023-03-03T07:43:29.819125+0000","last_unstale":"2023-03-03T07:43:36.373715+0000","last_undegraded":"2023-03-03T07:43:36.373715+0000","last_fullsized":"2023-03-03T07:43:36.373715+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_clean_scrub_stamp":"2023-03-03T07:43:28.794012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:48:46.625707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379126+0000","last_change":"2023-03-03T07:43:35.893902+0000","last_active":"2023-03-03T07:43:37.379126+0000","last_peered":"2023-03-03T07:43:37.379126+0000","last_clean":"2023-03-03T07:43:37.379126+0000","last_became_active":"2023-03-03T07:43:35.893653+0000","last_became_peered":"2023-03-03T07:43:35.893653+0000","last_unstale":"2023-03-03T07:43:37.379126+0000","last_undegraded":"2023-03-03T07:43:37.379126+0000","last_fullsized":"2023-03-03T07:43:37.379126+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T19:12:31.497654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379473+0000","last_change":"2023-03-03T07:43:36.391576+0000","last_active":"2023-03-03T07:43:37.379473+0000","last_peered":"2023-03-03T07:43:37.379473+0000","last_clean":"2023-03-03T07:43:37.379473+0000","last_became_active":"2023-03-03T07:43:36.388391+0000","last_became_peered":"2023-03-03T07:43:36.388391+0000","last_unstale":"2023-03-03T07:43:37.379473+0000","last_undegraded":"2023-03-03T07:43:37.379473+0000","last_fullsized":"2023-03-03T07:43:37.379473+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:44:38.954038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-03-03T07:43:36.365185+0000","last_change":"2023-03-03T07:43:29.821593+0000","last_active":"2023-03-03T07:43:36.365185+0000","last_peered":"2023-03-03T07:43:36.365185+0000","last_clean":"2023-03-03T07:43:36.365185+0000","last_became_active":"2023-03-03T07:43:29.821155+0000","last_became_peered":"2023-03-03T07:43:29.821155+0000","last_unstale":"2023-03-03T07:43:36.365185+0000","last_undegraded":"2023-03-03T07:43:36.365185+0000","last_fullsized":"2023-03-03T07:43:36.365185+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_clean_scrub_stamp":"2023-03-03T07:43:28.794012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:16:45.103665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378480+0000","last_change":"2023-03-03T07:43:35.890752+0000","last_active":"2023-03-03T07:43:37.378480+0000","last_peered":"2023-03-03T07:43:37.378480+0000","last_clean":"2023-03-03T07:43:37.378480+0000","last_became_active":"2023-03-03T07:43:35.888875+0000","last_became_peered":"2023-03-03T07:43:35.888875+0000","last_unstale":"2023-03-03T07:43:37.378480+0000","last_undegraded":"2023-03-03T07:43:37.378480+0000","last_fullsized":"2023-03-03T07:43:37.378480+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:08:43.703528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379368+0000","last_change":"2023-03-03T07:43:36.392018+0000","last_active":"2023-03-03T07:43:37.379368+0000","last_peered":"2023-03-03T07:43:37.379368+0000","last_clean":"2023-03-03T07:43:37.379368+0000","last_became_active":"2023-03-03T07:43:36.389351+0000","last_became_peered":"2023-03-03T07:43:36.389351+0000","last_unstale":"2023-03-03T07:43:37.379368+0000","last_undegraded":"2023-03-03T07:43:37.379368+0000","last_fullsized":"2023-03-03T07:43:37.379368+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:52:03.369684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-03-03T07:43:36.373450+0000","last_change":"2023-03-03T07:43:29.820869+0000","last_active":"2023-03-03T07:43:36.373450+0000","last_peered":"2023-03-03T07:43:36.373450+0000","last_clean":"2023-03-03T07:43:36.373450+0000","last_became_active":"2023-03-03T07:43:29.820454+0000","last_became_peered":"2023-03-03T07:43:29.820454+0000","last_unstale":"2023-03-03T07:43:36.373450+0000","last_undegraded":"2023-03-03T07:43:36.373450+0000","last_fullsized":"2023-03-03T07:43:36.373450+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_clean_scrub_stamp":"2023-03-03T07:43:28.794012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:06:02.760825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377296+0000","last_change":"2023-03-03T07:43:35.888736+0000","last_active":"2023-03-03T07:43:37.377296+0000","last_peered":"2023-03-03T07:43:37.377296+0000","last_clean":"2023-03-03T07:43:37.377296+0000","last_became_active":"2023-03-03T07:43:35.884537+0000","last_became_peered":"2023-03-03T07:43:35.884537+0000","last_unstale":"2023-03-03T07:43:37.377296+0000","last_undegraded":"2023-03-03T07:43:37.377296+0000","last_fullsized":"2023-03-03T07:43:37.377296+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:33:42.799055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381565+0000","last_change":"2023-03-03T07:43:36.393538+0000","last_active":"2023-03-03T07:43:37.381565+0000","last_peered":"2023-03-03T07:43:37.381565+0000","last_clean":"2023-03-03T07:43:37.381565+0000","last_became_active":"2023-03-03T07:43:36.389830+0000","last_became_peered":"2023-03-03T07:43:36.389830+0000","last_unstale":"2023-03-03T07:43:37.381565+0000","last_undegraded":"2023-03-03T07:43:37.381565+0000","last_fullsized":"2023-03-03T07:43:37.381565+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:55:45.795027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-03-03T07:43:36.373791+0000","last_change":"2023-03-03T07:43:29.821156+0000","last_active":"2023-03-03T07:43:36.373791+0000","last_peered":"2023-03-03T07:43:36.373791+0000","last_clean":"2023-03-03T07:43:36.373791+0000","last_became_active":"2023-03-03T07:43:29.820471+0000","last_became_peered":"2023-03-03T07:43:29.820471+0000","last_unstale":"2023-03-03T07:43:36.373791+0000","last_undegraded":"2023-03-03T07:43:36.373791+0000","last_fullsized":"2023-03-03T07:43:36.373791+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_clean_scrub_stamp":"2023-03-03T07:43:28.794012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:37:24.335449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379199+0000","last_change":"2023-03-03T07:43:35.895634+0000","last_active":"2023-03-03T07:43:37.379199+0000","last_peered":"2023-03-03T07:43:37.379199+0000","last_clean":"2023-03-03T07:43:37.379199+0000","last_became_active":"2023-03-03T07:43:35.895036+0000","last_became_peered":"2023-03-03T07:43:35.895036+0000","last_unstale":"2023-03-03T07:43:37.379199+0000","last_undegraded":"2023-03-03T07:43:37.379199+0000","last_fullsized":"2023-03-03T07:43:37.379199+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:49:24.082901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378991+0000","last_change":"2023-03-03T07:43:36.393263+0000","last_active":"2023-03-03T07:43:37.378991+0000","last_peered":"2023-03-03T07:43:37.378991+0000","last_clean":"2023-03-03T07:43:37.378991+0000","last_became_active":"2023-03-03T07:43:36.389601+0000","last_became_peered":"2023-03-03T07:43:36.389601+0000","last_unstale":"2023-03-03T07:43:37.378991+0000","last_undegraded":"2023-03-03T07:43:37.378991+0000","last_fullsized":"2023-03-03T07:43:37.378991+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:01:37.629716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381257+0000","last_change":"2023-03-03T07:43:35.895765+0000","last_active":"2023-03-03T07:43:37.381257+0000","last_peered":"2023-03-03T07:43:37.381257+0000","last_clean":"2023-03-03T07:43:37.381257+0000","last_became_active":"2023-03-03T07:43:35.894899+0000","last_became_peered":"2023-03-03T07:43:35.894899+0000","last_unstale":"2023-03-03T07:43:37.381257+0000","last_undegraded":"2023-03-03T07:43:37.381257+0000","last_fullsized":"2023-03-03T07:43:37.381257+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:26:15.189150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-03-03T07:43:36.372489+0000","last_change":"2023-03-03T07:43:29.822165+0000","last_active":"2023-03-03T07:43:36.372489+0000","last_peered":"2023-03-03T07:43:36.372489+0000","last_clean":"2023-03-03T07:43:36.372489+0000","last_became_active":"2023-03-03T07:43:29.821857+0000","last_became_peered":"2023-03-03T07:43:29.821857+0000","last_unstale":"2023-03-03T07:43:36.372489+0000","last_undegraded":"2023-03-03T07:43:36.372489+0000","last_fullsized":"2023-03-03T07:43:36.372489+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_clean_scrub_stamp":"2023-03-03T07:43:28.794012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:25:47.435749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378190+0000","last_change":"2023-03-03T07:43:36.383035+0000","last_active":"2023-03-03T07:43:37.378190+0000","last_peered":"2023-03-03T07:43:37.378190+0000","last_clean":"2023-03-03T07:43:37.378190+0000","last_became_active":"2023-03-03T07:43:36.380972+0000","last_became_peered":"2023-03-03T07:43:36.380972+0000","last_unstale":"2023-03-03T07:43:37.378190+0000","last_undegraded":"2023-03-03T07:43:37.378190+0000","last_fullsized":"2023-03-03T07:43:37.378190+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:48:16.722595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379574+0000","last_change":"2023-03-03T07:43:35.896322+0000","last_active":"2023-03-03T07:43:37.379574+0000","last_peered":"2023-03-03T07:43:37.379574+0000","last_clean":"2023-03-03T07:43:37.379574+0000","last_became_active":"2023-03-03T07:43:35.895238+0000","last_became_peered":"2023-03-03T07:43:35.895238+0000","last_unstale":"2023-03-03T07:43:37.379574+0000","last_undegraded":"2023-03-03T07:43:37.379574+0000","last_fullsized":"2023-03-03T07:43:37.379574+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:51:03.914235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-03-03T07:43:36.375587+0000","last_change":"2023-03-03T07:43:29.820875+0000","last_active":"2023-03-03T07:43:36.375587+0000","last_peered":"2023-03-03T07:43:36.375587+0000","last_clean":"2023-03-03T07:43:36.375587+0000","last_became_active":"2023-03-03T07:43:29.820497+0000","last_became_peered":"2023-03-03T07:43:29.820497+0000","last_unstale":"2023-03-03T07:43:36.375587+0000","last_undegraded":"2023-03-03T07:43:36.375587+0000","last_fullsized":"2023-03-03T07:43:36.375587+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_clean_scrub_stamp":"2023-03-03T07:43:28.794012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:47:10.778507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378313+0000","last_change":"2023-03-03T07:43:36.389829+0000","last_active":"2023-03-03T07:43:37.378313+0000","last_peered":"2023-03-03T07:43:37.378313+0000","last_clean":"2023-03-03T07:43:37.378313+0000","last_became_active":"2023-03-03T07:43:36.389575+0000","last_became_peered":"2023-03-03T07:43:36.389575+0000","last_unstale":"2023-03-03T07:43:37.378313+0000","last_undegraded":"2023-03-03T07:43:37.378313+0000","last_fullsized":"2023-03-03T07:43:37.378313+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:19:30.092333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"15'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.382039+0000","last_change":"2023-03-03T07:43:35.895805+0000","last_active":"2023-03-03T07:43:37.382039+0000","last_peered":"2023-03-03T07:43:37.382039+0000","last_clean":"2023-03-03T07:43:37.382039+0000","last_became_active":"2023-03-03T07:43:35.894950+0000","last_became_peered":"2023-03-03T07:43:35.894950+0000","last_unstale":"2023-03-03T07:43:37.382039+0000","last_undegraded":"2023-03-03T07:43:37.382039+0000","last_fullsized":"2023-03-03T07:43:37.382039+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T19:14:52.719580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":1,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-03-03T07:43:36.375541+0000","last_change":"2023-03-03T07:43:29.821552+0000","last_active":"2023-03-03T07:43:36.375541+0000","last_peered":"2023-03-03T07:43:36.375541+0000","last_clean":"2023-03-03T07:43:36.375541+0000","last_became_active":"2023-03-03T07:43:29.820710+0000","last_became_peered":"2023-03-03T07:43:29.820710+0000","last_unstale":"2023-03-03T07:43:36.375541+0000","last_undegraded":"2023-03-03T07:43:36.375541+0000","last_fullsized":"2023-03-03T07:43:36.375541+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_clean_scrub_stamp":"2023-03-03T07:43:28.794012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T19:28:41.224615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377588+0000","last_change":"2023-03-03T07:43:36.385134+0000","last_active":"2023-03-03T07:43:37.377588+0000","last_peered":"2023-03-03T07:43:37.377588+0000","last_clean":"2023-03-03T07:43:37.377588+0000","last_became_active":"2023-03-03T07:43:36.384452+0000","last_became_peered":"2023-03-03T07:43:36.384452+0000","last_unstale":"2023-03-03T07:43:37.377588+0000","last_undegraded":"2023-03-03T07:43:37.377588+0000","last_fullsized":"2023-03-03T07:43:37.377588+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:48:13.186580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.756044+0000","last_change":"2023-03-03T07:43:35.896493+0000","last_active":"2023-03-03T07:43:37.756044+0000","last_peered":"2023-03-03T07:43:37.756044+0000","last_clean":"2023-03-03T07:43:37.756044+0000","last_became_active":"2023-03-03T07:43:35.894837+0000","last_became_peered":"2023-03-03T07:43:35.894837+0000","last_unstale":"2023-03-03T07:43:37.756044+0000","last_undegraded":"2023-03-03T07:43:37.756044+0000","last_fullsized":"2023-03-03T07:43:37.756044+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:07:11.749055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":1,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-03-03T07:43:36.373487+0000","last_change":"2023-03-03T07:43:29.822831+0000","last_active":"2023-03-03T07:43:36.373487+0000","last_peered":"2023-03-03T07:43:36.373487+0000","last_clean":"2023-03-03T07:43:36.373487+0000","last_became_active":"2023-03-03T07:43:29.822123+0000","last_became_peered":"2023-03-03T07:43:29.822123+0000","last_unstale":"2023-03-03T07:43:36.373487+0000","last_undegraded":"2023-03-03T07:43:36.373487+0000","last_fullsized":"2023-03-03T07:43:36.373487+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:28.794012+0000","last_clean_scrub_stamp":"2023-03-03T07:43:28.794012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:22:14.249159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378057+0000","last_change":"2023-03-03T07:43:36.387892+0000","last_active":"2023-03-03T07:43:37.378057+0000","last_peered":"2023-03-03T07:43:37.378057+0000","last_clean":"2023-03-03T07:43:37.378057+0000","last_became_active":"2023-03-03T07:43:36.387614+0000","last_became_peered":"2023-03-03T07:43:36.387614+0000","last_unstale":"2023-03-03T07:43:37.378057+0000","last_undegraded":"2023-03-03T07:43:37.378057+0000","last_fullsized":"2023-03-03T07:43:37.378057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:27:19.301365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378039+0000","last_change":"2023-03-03T07:43:36.377558+0000","last_active":"2023-03-03T07:43:37.378039+0000","last_peered":"2023-03-03T07:43:37.378039+0000","last_clean":"2023-03-03T07:43:37.378039+0000","last_became_active":"2023-03-03T07:43:36.377338+0000","last_became_peered":"2023-03-03T07:43:36.377338+0000","last_unstale":"2023-03-03T07:43:37.378039+0000","last_undegraded":"2023-03-03T07:43:37.378039+0000","last_fullsized":"2023-03-03T07:43:37.378039+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:52:56.959518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"15'6","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379411+0000","last_change":"2023-03-03T07:43:35.895416+0000","last_active":"2023-03-03T07:43:37.379411+0000","last_peered":"2023-03-03T07:43:37.379411+0000","last_clean":"2023-03-03T07:43:37.379411+0000","last_became_active":"2023-03-03T07:43:35.895003+0000","last_became_peered":"2023-03-03T07:43:35.895003+0000","last_unstale":"2023-03-03T07:43:37.379411+0000","last_undegraded":"2023-03-03T07:43:37.379411+0000","last_fullsized":"2023-03-03T07:43:37.379411+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:01:35.747172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378917+0000","last_change":"2023-03-03T07:43:36.393271+0000","last_active":"2023-03-03T07:43:37.378917+0000","last_peered":"2023-03-03T07:43:37.378917+0000","last_clean":"2023-03-03T07:43:37.378917+0000","last_became_active":"2023-03-03T07:43:36.392090+0000","last_became_peered":"2023-03-03T07:43:36.392090+0000","last_unstale":"2023-03-03T07:43:37.378917+0000","last_undegraded":"2023-03-03T07:43:37.378917+0000","last_fullsized":"2023-03-03T07:43:37.378917+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:37:14.185390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"15'3","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379351+0000","last_change":"2023-03-03T07:43:35.895610+0000","last_active":"2023-03-03T07:43:37.379351+0000","last_peered":"2023-03-03T07:43:37.379351+0000","last_clean":"2023-03-03T07:43:37.379351+0000","last_became_active":"2023-03-03T07:43:35.894334+0000","last_became_peered":"2023-03-03T07:43:35.894334+0000","last_unstale":"2023-03-03T07:43:37.379351+0000","last_undegraded":"2023-03-03T07:43:37.379351+0000","last_fullsized":"2023-03-03T07:43:37.379351+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:05:19.182581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381310+0000","last_change":"2023-03-03T07:43:35.894489+0000","last_active":"2023-03-03T07:43:37.381310+0000","last_peered":"2023-03-03T07:43:37.381310+0000","last_clean":"2023-03-03T07:43:37.381310+0000","last_became_active":"2023-03-03T07:43:35.894246+0000","last_became_peered":"2023-03-03T07:43:35.894246+0000","last_unstale":"2023-03-03T07:43:37.381310+0000","last_undegraded":"2023-03-03T07:43:37.381310+0000","last_fullsized":"2023-03-03T07:43:37.381310+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:57:25.492548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377698+0000","last_change":"2023-03-03T07:43:36.382817+0000","last_active":"2023-03-03T07:43:37.377698+0000","last_peered":"2023-03-03T07:43:37.377698+0000","last_clean":"2023-03-03T07:43:37.377698+0000","last_became_active":"2023-03-03T07:43:36.381184+0000","last_became_peered":"2023-03-03T07:43:36.381184+0000","last_unstale":"2023-03-03T07:43:37.377698+0000","last_undegraded":"2023-03-03T07:43:37.377698+0000","last_fullsized":"2023-03-03T07:43:37.377698+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:48:21.525727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381814+0000","last_change":"2023-03-03T07:43:35.895790+0000","last_active":"2023-03-03T07:43:37.381814+0000","last_peered":"2023-03-03T07:43:37.381814+0000","last_clean":"2023-03-03T07:43:37.381814+0000","last_became_active":"2023-03-03T07:43:35.894635+0000","last_became_peered":"2023-03-03T07:43:35.894635+0000","last_unstale":"2023-03-03T07:43:37.381814+0000","last_undegraded":"2023-03-03T07:43:37.381814+0000","last_fullsized":"2023-03-03T07:43:37.381814+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:00:25.399331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377726+0000","last_change":"2023-03-03T07:43:36.385314+0000","last_active":"2023-03-03T07:43:37.377726+0000","last_peered":"2023-03-03T07:43:37.377726+0000","last_clean":"2023-03-03T07:43:37.377726+0000","last_became_active":"2023-03-03T07:43:36.384718+0000","last_became_peered":"2023-03-03T07:43:36.384718+0000","last_unstale":"2023-03-03T07:43:37.377726+0000","last_undegraded":"2023-03-03T07:43:37.377726+0000","last_fullsized":"2023-03-03T07:43:37.377726+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T19:26:37.184969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378596+0000","last_change":"2023-03-03T07:43:36.386105+0000","last_active":"2023-03-03T07:43:37.378596+0000","last_peered":"2023-03-03T07:43:37.378596+0000","last_clean":"2023-03-03T07:43:37.378596+0000","last_became_active":"2023-03-03T07:43:36.385731+0000","last_became_peered":"2023-03-03T07:43:36.385731+0000","last_unstale":"2023-03-03T07:43:37.378596+0000","last_undegraded":"2023-03-03T07:43:37.378596+0000","last_fullsized":"2023-03-03T07:43:37.378596+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T19:26:45.707634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377039+0000","last_change":"2023-03-03T07:43:35.885660+0000","last_active":"2023-03-03T07:43:37.377039+0000","last_peered":"2023-03-03T07:43:37.377039+0000","last_clean":"2023-03-03T07:43:37.377039+0000","last_became_active":"2023-03-03T07:43:35.883112+0000","last_became_peered":"2023-03-03T07:43:35.883112+0000","last_unstale":"2023-03-03T07:43:37.377039+0000","last_undegraded":"2023-03-03T07:43:37.377039+0000","last_fullsized":"2023-03-03T07:43:37.377039+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:00:22.463509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381401+0000","last_change":"2023-03-03T07:43:36.391839+0000","last_active":"2023-03-03T07:43:37.381401+0000","last_peered":"2023-03-03T07:43:37.381401+0000","last_clean":"2023-03-03T07:43:37.381401+0000","last_became_active":"2023-03-03T07:43:36.388296+0000","last_became_peered":"2023-03-03T07:43:36.388296+0000","last_unstale":"2023-03-03T07:43:37.381401+0000","last_undegraded":"2023-03-03T07:43:37.381401+0000","last_fullsized":"2023-03-03T07:43:37.381401+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:50:23.423175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377857+0000","last_change":"2023-03-03T07:43:35.888737+0000","last_active":"2023-03-03T07:43:37.377857+0000","last_peered":"2023-03-03T07:43:37.377857+0000","last_clean":"2023-03-03T07:43:37.377857+0000","last_became_active":"2023-03-03T07:43:35.886324+0000","last_became_peered":"2023-03-03T07:43:35.886324+0000","last_unstale":"2023-03-03T07:43:37.377857+0000","last_undegraded":"2023-03-03T07:43:37.377857+0000","last_fullsized":"2023-03-03T07:43:37.377857+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:17:39.088385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378888+0000","last_change":"2023-03-03T07:43:36.391334+0000","last_active":"2023-03-03T07:43:37.378888+0000","last_peered":"2023-03-03T07:43:37.378888+0000","last_clean":"2023-03-03T07:43:37.378888+0000","last_became_active":"2023-03-03T07:43:36.387583+0000","last_became_peered":"2023-03-03T07:43:36.387583+0000","last_unstale":"2023-03-03T07:43:37.378888+0000","last_undegraded":"2023-03-03T07:43:37.378888+0000","last_fullsized":"2023-03-03T07:43:37.378888+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:29:23.983350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378556+0000","last_change":"2023-03-03T07:43:35.888455+0000","last_active":"2023-03-03T07:43:37.378556+0000","last_peered":"2023-03-03T07:43:37.378556+0000","last_clean":"2023-03-03T07:43:37.378556+0000","last_became_active":"2023-03-03T07:43:35.888141+0000","last_became_peered":"2023-03-03T07:43:35.888141+0000","last_unstale":"2023-03-03T07:43:37.378556+0000","last_undegraded":"2023-03-03T07:43:37.378556+0000","last_fullsized":"2023-03-03T07:43:37.378556+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:16:28.849552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378309+0000","last_change":"2023-03-03T07:43:36.392205+0000","last_active":"2023-03-03T07:43:37.378309+0000","last_peered":"2023-03-03T07:43:37.378309+0000","last_clean":"2023-03-03T07:43:37.378309+0000","last_became_active":"2023-03-03T07:43:36.388128+0000","last_became_peered":"2023-03-03T07:43:36.388128+0000","last_unstale":"2023-03-03T07:43:37.378309+0000","last_undegraded":"2023-03-03T07:43:37.378309+0000","last_fullsized":"2023-03-03T07:43:37.378309+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:37:51.500144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378540+0000","last_change":"2023-03-03T07:43:35.893932+0000","last_active":"2023-03-03T07:43:37.378540+0000","last_peered":"2023-03-03T07:43:37.378540+0000","last_clean":"2023-03-03T07:43:37.378540+0000","last_became_active":"2023-03-03T07:43:35.893689+0000","last_became_peered":"2023-03-03T07:43:35.893689+0000","last_unstale":"2023-03-03T07:43:37.378540+0000","last_undegraded":"2023-03-03T07:43:37.378540+0000","last_fullsized":"2023-03-03T07:43:37.378540+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:26:49.876498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378002+0000","last_change":"2023-03-03T07:43:36.377538+0000","last_active":"2023-03-03T07:43:37.378002+0000","last_peered":"2023-03-03T07:43:37.378002+0000","last_clean":"2023-03-03T07:43:37.378002+0000","last_became_active":"2023-03-03T07:43:36.377279+0000","last_became_peered":"2023-03-03T07:43:36.377279+0000","last_unstale":"2023-03-03T07:43:37.378002+0000","last_undegraded":"2023-03-03T07:43:37.378002+0000","last_fullsized":"2023-03-03T07:43:37.378002+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:26:17.662598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379204+0000","last_change":"2023-03-03T07:43:35.893989+0000","last_active":"2023-03-03T07:43:37.379204+0000","last_peered":"2023-03-03T07:43:37.379204+0000","last_clean":"2023-03-03T07:43:37.379204+0000","last_became_active":"2023-03-03T07:43:35.893701+0000","last_became_peered":"2023-03-03T07:43:35.893701+0000","last_unstale":"2023-03-03T07:43:37.379204+0000","last_undegraded":"2023-03-03T07:43:37.379204+0000","last_fullsized":"2023-03-03T07:43:37.379204+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:59:24.744163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":1,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.378705+0000","last_change":"2023-03-03T07:43:36.383356+0000","last_active":"2023-03-03T07:43:37.378705+0000","last_peered":"2023-03-03T07:43:37.378705+0000","last_clean":"2023-03-03T07:43:37.378705+0000","last_became_active":"2023-03-03T07:43:36.381546+0000","last_became_peered":"2023-03-03T07:43:36.381546+0000","last_unstale":"2023-03-03T07:43:37.378705+0000","last_undegraded":"2023-03-03T07:43:37.378705+0000","last_fullsized":"2023-03-03T07:43:37.378705+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:06:50.266644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"15'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379105+0000","last_change":"2023-03-03T07:43:35.894711+0000","last_active":"2023-03-03T07:43:37.379105+0000","last_peered":"2023-03-03T07:43:37.379105+0000","last_clean":"2023-03-03T07:43:37.379105+0000","last_became_active":"2023-03-03T07:43:35.893970+0000","last_became_peered":"2023-03-03T07:43:35.893970+0000","last_unstale":"2023-03-03T07:43:37.379105+0000","last_undegraded":"2023-03-03T07:43:37.379105+0000","last_fullsized":"2023-03-03T07:43:37.379105+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:17:16.461687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":1,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.379601+0000","last_change":"2023-03-03T07:43:36.389431+0000","last_active":"2023-03-03T07:43:37.379601+0000","last_peered":"2023-03-03T07:43:37.379601+0000","last_clean":"2023-03-03T07:43:37.379601+0000","last_became_active":"2023-03-03T07:43:36.388088+0000","last_became_peered":"2023-03-03T07:43:36.388088+0000","last_unstale":"2023-03-03T07:43:37.379601+0000","last_undegraded":"2023-03-03T07:43:37.379601+0000","last_fullsized":"2023-03-03T07:43:37.379601+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:38:06.090984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381157+0000","last_change":"2023-03-03T07:43:35.896502+0000","last_active":"2023-03-03T07:43:37.381157+0000","last_peered":"2023-03-03T07:43:37.381157+0000","last_clean":"2023-03-03T07:43:37.381157+0000","last_became_active":"2023-03-03T07:43:35.896259+0000","last_became_peered":"2023-03-03T07:43:35.896259+0000","last_unstale":"2023-03-03T07:43:37.381157+0000","last_undegraded":"2023-03-03T07:43:37.381157+0000","last_fullsized":"2023-03-03T07:43:37.381157+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:16:57.833751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.377310+0000","last_change":"2023-03-03T07:43:36.385037+0000","last_active":"2023-03-03T07:43:37.377310+0000","last_peered":"2023-03-03T07:43:37.377310+0000","last_clean":"2023-03-03T07:43:37.377310+0000","last_became_active":"2023-03-03T07:43:36.383754+0000","last_became_peered":"2023-03-03T07:43:36.383754+0000","last_unstale":"2023-03-03T07:43:37.377310+0000","last_undegraded":"2023-03-03T07:43:37.377310+0000","last_fullsized":"2023-03-03T07:43:37.377310+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:35.852890+0000","last_clean_scrub_stamp":"2023-03-03T07:43:35.852890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:23:35.231949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-03-03T07:43:37.381694+0000","last_change":"2023-03-03T07:43:35.895981+0000","last_active":"2023-03-03T07:43:37.381694+0000","last_peered":"2023-03-03T07:43:37.381694+0000","last_clean":"2023-03-03T07:43:37.381694+0000","last_became_active":"2023-03-03T07:43:35.895386+0000","last_became_peered":"2023-03-03T07:43:35.895386+0000","last_unstale":"2023-03-03T07:43:37.381694+0000","last_undegraded":"2023-03-03T07:43:37.381694+0000","last_fullsized":"2023-03-03T07:43:37.381694+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T07:43:34.841803+0000","last_clean_scrub_stamp":"2023-03-03T07:43:34.841803+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:55:52.173973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":1},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":32,"acting":32,"num_store_stats":1},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":8,"acting":8,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":1,"acting":1,"num_store_stats":1}],"osd_stats":[{"osd":0,"up_from":6,"seq":25769803783,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":1048576,"kb_used":9332,"kb_used_data":748,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":1039244,"statfs":{"total":1073741824,"available":1064185856,"internally_reserved":0,"allocated":765952,"data_stored":631325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-03T07:43:47.346 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-03-03T07:43:47.346 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-03-03T07:43:47.346 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-03-03T07:43:47.347 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-03-03T07:43:47.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.588+0000 7fa606334700 1 Processor -- start 2023-03-03T07:43:47.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.588+0000 7fa606334700 1 -- start start 2023-03-03T07:43:47.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.588+0000 7fa606334700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa600128a20 0x7fa60012ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:47.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.588+0000 7fa606334700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa60008d6f0 con 0x7fa600123b10 2023-03-03T07:43:47.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.588+0000 7fa606334700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6001235a0 con 0x7fa600128a20 2023-03-03T07:43:47.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.588+0000 7fa605332700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa600123b10 0x7fa600123ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56904/0 (socket says 172.21.15.57:56904) 2023-03-03T07:43:47.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.588+0000 7fa605332700 1 -- 172.21.15.57:0/1689981653 learned_addr learned my addr 172.21.15.57:0/1689981653 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:43:47.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.588+0000 7fa604b31700 1 --2- 172.21.15.57:0/1689981653 >> v2:172.21.15.57:3300/0 conn(0x7fa600128a20 0x7fa60012ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:47.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.588+0000 7fa5f7fff700 1 -- 172.21.15.57:0/1689981653 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 191146059 0 0) 0x7fa60008d6f0 con 0x7fa600123b10 2023-03-03T07:43:47.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.588+0000 7fa5f7fff700 1 -- 172.21.15.57:0/1689981653 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5ec0035d0 con 0x7fa600123b10 2023-03-03T07:43:47.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.588+0000 7fa5f7fff700 1 -- 172.21.15.57:0/1689981653 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 533128417 0 0) 0x7fa5ec0035d0 con 0x7fa600123b10 2023-03-03T07:43:47.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.588+0000 7fa5f7fff700 1 -- 172.21.15.57:0/1689981653 >> v2:172.21.15.57:3300/0 conn(0x7fa600128a20 msgr2=0x7fa60012ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T07:43:47.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.588+0000 7fa5f7fff700 1 --2- 172.21.15.57:0/1689981653 >> v2:172.21.15.57:3300/0 conn(0x7fa600128a20 0x7fa60012ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:47.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.588+0000 7fa5f7fff700 1 -- 172.21.15.57:0/1689981653 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa60008d420 con 0x7fa600123b10 2023-03-03T07:43:47.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.592+0000 7fa5f7fff700 1 -- 172.21.15.57:0/1689981653 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (unknown 2779775165 0 0) 0x7fa5fc0015a0 con 0x7fa600123b10 2023-03-03T07:43:47.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.592+0000 7fa604b31700 1 --2- 172.21.15.57:0/1689981653 >> v2:172.21.15.57:3300/0 conn(0x7fa600128a20 0x7fa60012ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T07:43:47.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.592+0000 7fa5f7fff700 1 -- 172.21.15.57:0/1689981653 >> v1:172.21.15.57:6789/0 conn(0x7fa600123b10 legacy=0x7fa600123ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:47.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.592+0000 7fa5f7fff700 1 --2- 172.21.15.57:0/1689981653 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5ec003ae0 0x7fa5ec003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:47.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.592+0000 7fa5f7fff700 1 -- 172.21.15.57:0/1689981653 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6001235a0 con 0x7fa5ec003ae0 2023-03-03T07:43:47.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.592+0000 7fa605332700 1 --2- 172.21.15.57:0/1689981653 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5ec003ae0 0x7fa5ec003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:47.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.592+0000 7fa605332700 1 -- 172.21.15.57:0/1689981653 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5ec0035d0 con 0x7fa5ec003ae0 2023-03-03T07:43:47.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.592+0000 7fa605332700 1 --2- 172.21.15.57:0/1689981653 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5ec003ae0 0x7fa5ec003ed0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc007fb0 tx=0x7fa5ec0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd0d03c94eb70a73 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:47.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.592+0000 7fa5f7fff700 1 -- 172.21.15.57:0/1689981653 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa5fc00cb00 con 0x7fa5ec003ae0 2023-03-03T07:43:47.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.592+0000 7fa5f7fff700 1 -- 172.21.15.57:0/1689981653 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5fc00cc60 con 0x7fa5ec003ae0 2023-03-03T07:43:47.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.592+0000 7fa5f7fff700 1 -- 172.21.15.57:0/1689981653 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa5fc005980 con 0x7fa5ec003ae0 2023-03-03T07:43:47.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.592+0000 7fa606334700 1 -- 172.21.15.57:0/1689981653 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5ec003ae0 msgr2=0x7fa5ec003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:47.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.592+0000 7fa606334700 1 --2- 172.21.15.57:0/1689981653 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5ec003ae0 0x7fa5ec003ed0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc007fb0 tx=0x7fa5ec0058a0 comp rx=0 tx=0).stop 2023-03-03T07:43:47.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.592+0000 7fa606334700 1 -- 172.21.15.57:0/1689981653 shutdown_connections 2023-03-03T07:43:47.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.592+0000 7fa606334700 1 --2- 172.21.15.57:0/1689981653 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5ec003ae0 0x7fa5ec003ed0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:47.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.592+0000 7fa606334700 1 --2- 172.21.15.57:0/1689981653 >> v2:172.21.15.57:3300/0 conn(0x7fa600128a20 0x7fa60012ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:47.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.592+0000 7fa606334700 1 -- 172.21.15.57:0/1689981653 >> 172.21.15.57:0/1689981653 conn(0x7fa60006c840 msgr2=0x7fa60006ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:47.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.596+0000 7fa606334700 1 -- 172.21.15.57:0/1689981653 shutdown_connections 2023-03-03T07:43:47.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.596+0000 7fa606334700 1 -- 172.21.15.57:0/1689981653 wait complete. 2023-03-03T07:43:47.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.596+0000 7fa606334700 1 Processor -- start 2023-03-03T07:43:47.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.596+0000 7fa606334700 1 -- start start 2023-03-03T07:43:47.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.600+0000 7fa606334700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5ec003ae0 0x7fa600095630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:47.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.600+0000 7fa606334700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6000926c0 con 0x7fa5ec003ae0 2023-03-03T07:43:47.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.600+0000 7fa605332700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5ec003ae0 0x7fa600095630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:47.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.600+0000 7fa605332700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5ec003ae0 0x7fa600095630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35796/0 (socket says 172.21.15.57:35796) 2023-03-03T07:43:47.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.600+0000 7fa605332700 1 -- 172.21.15.57:0/2377481939 learned_addr learned my addr 172.21.15.57:0/2377481939 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:47.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.600+0000 7fa605332700 1 -- 172.21.15.57:0/2377481939 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f00094b0 con 0x7fa5ec003ae0 2023-03-03T07:43:47.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.600+0000 7fa605332700 1 --2- 172.21.15.57:0/2377481939 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5ec003ae0 0x7fa600095630 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa6001245f0 tx=0x7fa5fc001860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:47.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.600+0000 7fa5f5ffb700 1 -- 172.21.15.57:0/2377481939 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa5fc001370 con 0x7fa5ec003ae0 2023-03-03T07:43:47.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.600+0000 7fa5f5ffb700 1 -- 172.21.15.57:0/2377481939 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5fc0014d0 con 0x7fa5ec003ae0 2023-03-03T07:43:47.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.600+0000 7fa5f5ffb700 1 -- 172.21.15.57:0/2377481939 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa5fc007200 con 0x7fa5ec003ae0 2023-03-03T07:43:47.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.600+0000 7fa606334700 1 -- 172.21.15.57:0/2377481939 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa60008b220 con 0x7fa5ec003ae0 2023-03-03T07:43:47.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.600+0000 7fa606334700 1 -- 172.21.15.57:0/2377481939 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa60008b090 con 0x7fa5ec003ae0 2023-03-03T07:43:47.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.604+0000 7fa606334700 1 -- 172.21.15.57:0/2377481939 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa60008b3b0 con 0x7fa5ec003ae0 2023-03-03T07:43:47.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.604+0000 7fa5f5ffb700 1 -- 172.21.15.57:0/2377481939 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42205+0+0 (secure 0 0 0) 0x7fa5fc010070 con 0x7fa5ec003ae0 2023-03-03T07:43:47.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.604+0000 7fa5f5ffb700 1 --2- 172.21.15.57:0/2377481939 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fa5e4034830 0x7fa5e4036ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:47.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.604+0000 7fa5f5ffb700 1 -- 172.21.15.57:0/2377481939 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2928+0+0 (secure 0 0 0) 0x7fa5fc0470a0 con 0x7fa5ec003ae0 2023-03-03T07:43:47.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.604+0000 7fa604b31700 1 --2- 172.21.15.57:0/2377481939 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fa5e4034830 0x7fa5e4036ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:47.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.608+0000 7fa604b31700 1 --2- 172.21.15.57:0/2377481939 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fa5e4034830 0x7fa5e4036ce0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0009b50 tx=0x7fa5f0009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:47.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.612+0000 7fa5f5ffb700 1 -- 172.21.15.57:0/2377481939 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa5fc077400 con 0x7fa5ec003ae0 2023-03-03T07:43:47.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.820+0000 7fa606334700 1 -- 172.21.15.57:0/2377481939 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa6000619b0 con 0x7fa5ec003ae0 2023-03-03T07:43:47.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.820+0000 7fa5f5ffb700 1 -- 172.21.15.57:0/2377481939 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fa5fc017020 con 0x7fa5ec003ae0 2023-03-03T07:43:47.826 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-03T07:43:47.826 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-03-03T07:43:47.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.828+0000 7fa606334700 1 -- 172.21.15.57:0/2377481939 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fa5e4034830 msgr2=0x7fa5e4036ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:47.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.828+0000 7fa606334700 1 --2- 172.21.15.57:0/2377481939 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fa5e4034830 0x7fa5e4036ce0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0009b50 tx=0x7fa5f0009240 comp rx=0 tx=0).stop 2023-03-03T07:43:47.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.828+0000 7fa606334700 1 -- 172.21.15.57:0/2377481939 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5ec003ae0 msgr2=0x7fa600095630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:47.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.828+0000 7fa606334700 1 --2- 172.21.15.57:0/2377481939 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5ec003ae0 0x7fa600095630 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa6001245f0 tx=0x7fa5fc001860 comp rx=0 tx=0).stop 2023-03-03T07:43:47.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.828+0000 7fa606334700 1 -- 172.21.15.57:0/2377481939 shutdown_connections 2023-03-03T07:43:47.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.828+0000 7fa606334700 1 --2- 172.21.15.57:0/2377481939 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fa5e4034830 0x7fa5e4036ce0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:47.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.828+0000 7fa606334700 1 --2- 172.21.15.57:0/2377481939 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5ec003ae0 0x7fa600095630 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:47.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.828+0000 7fa606334700 1 -- 172.21.15.57:0/2377481939 >> 172.21.15.57:0/2377481939 conn(0x7fa60006c840 msgr2=0x7fa600124eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:47.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.828+0000 7fa606334700 1 -- 172.21.15.57:0/2377481939 shutdown_connections 2023-03-03T07:43:47.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:47.828+0000 7fa606334700 1 -- 172.21.15.57:0/2377481939 wait complete. 2023-03-03T07:43:47.864 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-03-03T07:43:47.865 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T07:43:48.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.064+0000 7feb399f9700 1 Processor -- start 2023-03-03T07:43:48.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.064+0000 7feb399f9700 1 -- start start 2023-03-03T07:43:48.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.064+0000 7feb399f9700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7feb340948e0 0x7feb3406ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:48.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.064+0000 7feb399f9700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb34071950 con 0x7feb3406f4b0 2023-03-03T07:43:48.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.064+0000 7feb399f9700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb34071330 con 0x7feb340948e0 2023-03-03T07:43:48.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.064+0000 7feb32ffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7feb340948e0 0x7feb3406ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:48.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.064+0000 7feb327fc700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7feb3406f4b0 0x7feb34128c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56906/0 (socket says 172.21.15.57:56906) 2023-03-03T07:43:48.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.064+0000 7feb327fc700 1 -- 172.21.15.57:0/639796367 learned_addr learned my addr 172.21.15.57:0/639796367 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:43:48.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.064+0000 7feb32ffd700 1 -- 172.21.15.57:0/639796367 >> v1:172.21.15.57:6789/0 conn(0x7feb3406f4b0 legacy=0x7feb34128c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:48.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.064+0000 7feb32ffd700 1 -- 172.21.15.57:0/639796367 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb34071640 con 0x7feb340948e0 2023-03-03T07:43:48.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.064+0000 7feb32ffd700 1 --2- 172.21.15.57:0/639796367 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb340948e0 0x7feb3406ef70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7feb240097d0 tx=0x7feb24009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f0422f1351526c8 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:48.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.068+0000 7feb31ffb700 1 -- 172.21.15.57:0/639796367 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb240041c0 con 0x7feb340948e0 2023-03-03T07:43:48.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.068+0000 7feb31ffb700 1 -- 172.21.15.57:0/639796367 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb24004320 con 0x7feb340948e0 2023-03-03T07:43:48.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.068+0000 7feb31ffb700 1 -- 172.21.15.57:0/639796367 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb240036c0 con 0x7feb340948e0 2023-03-03T07:43:48.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.068+0000 7feb399f9700 1 -- 172.21.15.57:0/639796367 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb340948e0 msgr2=0x7feb3406ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:48.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.068+0000 7feb399f9700 1 --2- 172.21.15.57:0/639796367 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb340948e0 0x7feb3406ef70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7feb240097d0 tx=0x7feb24009ae0 comp rx=0 tx=0).stop 2023-03-03T07:43:48.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.068+0000 7feb399f9700 1 -- 172.21.15.57:0/639796367 shutdown_connections 2023-03-03T07:43:48.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.068+0000 7feb399f9700 1 --2- 172.21.15.57:0/639796367 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb340948e0 0x7feb3406ef70 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:48.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.068+0000 7feb399f9700 1 -- 172.21.15.57:0/639796367 >> 172.21.15.57:0/639796367 conn(0x7feb34069f00 msgr2=0x7feb3406a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:48.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.068+0000 7feb399f9700 1 -- 172.21.15.57:0/639796367 shutdown_connections 2023-03-03T07:43:48.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.068+0000 7feb399f9700 1 -- 172.21.15.57:0/639796367 wait complete. 2023-03-03T07:43:48.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.072+0000 7feb399f9700 1 Processor -- start 2023-03-03T07:43:48.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.072+0000 7feb399f9700 1 -- start start 2023-03-03T07:43:48.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.072+0000 7feb399f9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb3406f4b0 0x7feb341b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:48.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.072+0000 7feb399f9700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb341212e0 con 0x7feb3406f4b0 2023-03-03T07:43:48.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.072+0000 7feb32ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb3406f4b0 0x7feb341b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:48.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.072+0000 7feb32ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb3406f4b0 0x7feb341b8c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35820/0 (socket says 172.21.15.57:35820) 2023-03-03T07:43:48.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.072+0000 7feb32ffd700 1 -- 172.21.15.57:0/2584233589 learned_addr learned my addr 172.21.15.57:0/2584233589 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:48.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.072+0000 7feb32ffd700 1 -- 172.21.15.57:0/2584233589 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb240094b0 con 0x7feb3406f4b0 2023-03-03T07:43:48.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.076+0000 7feb32ffd700 1 --2- 172.21.15.57:0/2584233589 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb3406f4b0 0x7feb341b8c10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7feb240090b0 tx=0x7feb24004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:48.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.076+0000 7feb1bfff700 1 -- 172.21.15.57:0/2584233589 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb2401d070 con 0x7feb3406f4b0 2023-03-03T07:43:48.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.076+0000 7feb1bfff700 1 -- 172.21.15.57:0/2584233589 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb24010940 con 0x7feb3406f4b0 2023-03-03T07:43:48.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.076+0000 7feb399f9700 1 -- 172.21.15.57:0/2584233589 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb3406faa0 con 0x7feb3406f4b0 2023-03-03T07:43:48.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.076+0000 7feb1bfff700 1 -- 172.21.15.57:0/2584233589 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb24010be0 con 0x7feb3406f4b0 2023-03-03T07:43:48.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.076+0000 7feb399f9700 1 -- 172.21.15.57:0/2584233589 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb3406f910 con 0x7feb3406f4b0 2023-03-03T07:43:48.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.076+0000 7feb1bfff700 1 -- 172.21.15.57:0/2584233589 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42205+0+0 (secure 0 0 0) 0x7feb24029030 con 0x7feb3406f4b0 2023-03-03T07:43:48.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.076+0000 7feb399f9700 1 -- 172.21.15.57:0/2584233589 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb3406fc30 con 0x7feb3406f4b0 2023-03-03T07:43:48.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.080+0000 7feb1bfff700 1 --2- 172.21.15.57:0/2584233589 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7feb200347e0 0x7feb20036c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:48.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.080+0000 7feb1bfff700 1 -- 172.21.15.57:0/2584233589 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2928+0+0 (secure 0 0 0) 0x7feb24047750 con 0x7feb3406f4b0 2023-03-03T07:43:48.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.080+0000 7feb327fc700 1 --2- 172.21.15.57:0/2584233589 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7feb200347e0 0x7feb20036c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:48.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.080+0000 7feb327fc700 1 --2- 172.21.15.57:0/2584233589 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7feb200347e0 0x7feb20036c90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7feb280018c0 tx=0x7feb28007a40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:48.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.084+0000 7feb1bfff700 1 -- 172.21.15.57:0/2584233589 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7feb240183f0 con 0x7feb3406f4b0 2023-03-03T07:43:48.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.260+0000 7feb399f9700 1 -- 172.21.15.57:0/2584233589 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb34120a40 con 0x7feb3406f4b0 2023-03-03T07:43:48.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.264+0000 7feb1bfff700 1 -- 172.21.15.57:0/2584233589 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+9544 (secure 0 0 0) 0x7feb24027030 con 0x7feb3406f4b0 2023-03-03T07:43:48.270 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-03T07:43:48.270 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":16,"fsid":"5022d617-ad40-4ad9-8d5b-120958296d9c","created":"2023-03-03T07:43:13.256676+0000","modified":"2023-03-03T07:43:37.358119+0000","last_up_change":"2023-03-03T07:43:22.721740+0000","last_in_change":"2023-03-03T07:43:13.786190+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":1,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-03T07:43:22.864508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":1,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"9","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":1,"score_stable":1,"optimal_score":1,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-03T07:43:28.091327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":1,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1,"score_stable":1,"optimal_score":1,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-03T07:43:33.981804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":1,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1,"score_stable":1,"optimal_score":1,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-03T07:43:35.408700+0000","flags":1,"flags_names":"hashpspool","type":1,"size":1,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1,"score_stable":1,"optimal_score":1,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d83f7ba7-9d9d-4309-95b9-2b8ad96f2f8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":6,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":28687},{"type":"v1","addr":"172.21.15.57:6801","nonce":28687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":28687},{"type":"v1","addr":"172.21.15.57:6803","nonce":28687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":28687},{"type":"v1","addr":"172.21.15.57:6807","nonce":28687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":28687},{"type":"v1","addr":"172.21.15.57:6805","nonce":28687}]},"public_addr":"172.21.15.57:6801/28687","cluster_addr":"172.21.15.57:6803/28687","heartbeat_back_addr":"172.21.15.57:6807/28687","heartbeat_front_addr":"172.21.15.57:6805/28687","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T07:43:19.859898+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T07:43:48.274 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.268+0000 7feb399f9700 1 -- 172.21.15.57:0/2584233589 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7feb200347e0 msgr2=0x7feb20036c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:48.274 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.268+0000 7feb399f9700 1 --2- 172.21.15.57:0/2584233589 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7feb200347e0 0x7feb20036c90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7feb280018c0 tx=0x7feb28007a40 comp rx=0 tx=0).stop 2023-03-03T07:43:48.274 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.268+0000 7feb399f9700 1 -- 172.21.15.57:0/2584233589 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb3406f4b0 msgr2=0x7feb341b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:48.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.268+0000 7feb399f9700 1 --2- 172.21.15.57:0/2584233589 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb3406f4b0 0x7feb341b8c10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7feb240090b0 tx=0x7feb24004770 comp rx=0 tx=0).stop 2023-03-03T07:43:48.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.268+0000 7feb399f9700 1 -- 172.21.15.57:0/2584233589 shutdown_connections 2023-03-03T07:43:48.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.268+0000 7feb399f9700 1 --2- 172.21.15.57:0/2584233589 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7feb200347e0 0x7feb20036c90 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:48.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.268+0000 7feb399f9700 1 --2- 172.21.15.57:0/2584233589 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb3406f4b0 0x7feb341b8c10 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:48.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.268+0000 7feb399f9700 1 -- 172.21.15.57:0/2584233589 >> 172.21.15.57:0/2584233589 conn(0x7feb34069f00 msgr2=0x7feb3406d6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:48.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.268+0000 7feb399f9700 1 -- 172.21.15.57:0/2584233589 shutdown_connections 2023-03-03T07:43:48.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.272+0000 7feb399f9700 1 -- 172.21.15.57:0/2584233589 wait complete. 2023-03-03T07:43:48.306 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-03T07:43:22.864508+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 1, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '9', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 1, 'score_stable': 1, 'optimal_score': 1, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-03-03T07:43:28.091327+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 1, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1, 'score_stable': 1, 'optimal_score': 1, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-03T07:43:33.981804+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 1, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1, 'score_stable': 1, 'optimal_score': 1, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-03-03T07:43:35.408700+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 1, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1, 'score_stable': 1, 'optimal_score': 1, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-03T07:43:48.307 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-03T07:43:48.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.512+0000 7f3a35d51700 1 Processor -- start 2023-03-03T07:43:48.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.512+0000 7f3a35d51700 1 -- start start 2023-03-03T07:43:48.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.512+0000 7f3a35d51700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3a3008aa80 0x7f3a3012d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:48.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.512+0000 7f3a35d51700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a3008c0d0 con 0x7f3a30096cd0 2023-03-03T07:43:48.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.512+0000 7f3a35d51700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a3008c3e0 con 0x7f3a3008aa80 2023-03-03T07:43:48.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.512+0000 7f3a27fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3a3008aa80 0x7f3a3012d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:48.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.512+0000 7f3a34d4f700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f3a30096cd0 0x7f3a3008a370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56922/0 (socket says 172.21.15.57:56922) 2023-03-03T07:43:48.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.512+0000 7f3a34d4f700 1 -- 172.21.15.57:0/3272187982 learned_addr learned my addr 172.21.15.57:0/3272187982 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:43:48.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.516+0000 7f3a277fe700 1 -- 172.21.15.57:0/3272187982 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1365953578 0 0) 0x7f3a3008c0d0 con 0x7f3a30096cd0 2023-03-03T07:43:48.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.516+0000 7f3a27fff700 1 -- 172.21.15.57:0/3272187982 >> v1:172.21.15.57:6789/0 conn(0x7f3a30096cd0 legacy=0x7f3a3008a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:48.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.516+0000 7f3a27fff700 1 -- 172.21.15.57:0/3272187982 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a3008ae90 con 0x7f3a3008aa80 2023-03-03T07:43:48.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.516+0000 7f3a27fff700 1 --2- 172.21.15.57:0/3272187982 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a3008aa80 0x7f3a3012d190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3a200097d0 tx=0x7f3a20009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41df74eb636d5718 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:48.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.516+0000 7f3a277fe700 1 -- 172.21.15.57:0/3272187982 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a200041c0 con 0x7f3a3008aa80 2023-03-03T07:43:48.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.516+0000 7f3a277fe700 1 -- 172.21.15.57:0/3272187982 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a20004320 con 0x7f3a3008aa80 2023-03-03T07:43:48.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.516+0000 7f3a277fe700 1 -- 172.21.15.57:0/3272187982 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a200036c0 con 0x7f3a3008aa80 2023-03-03T07:43:48.522 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.516+0000 7f3a35d51700 1 -- 172.21.15.57:0/3272187982 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a3008aa80 msgr2=0x7f3a3012d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:48.522 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.516+0000 7f3a35d51700 1 --2- 172.21.15.57:0/3272187982 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a3008aa80 0x7f3a3012d190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3a200097d0 tx=0x7f3a20009ae0 comp rx=0 tx=0).stop 2023-03-03T07:43:48.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.516+0000 7f3a35d51700 1 -- 172.21.15.57:0/3272187982 shutdown_connections 2023-03-03T07:43:48.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.516+0000 7f3a35d51700 1 --2- 172.21.15.57:0/3272187982 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a3008aa80 0x7f3a3012d190 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:48.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.516+0000 7f3a35d51700 1 -- 172.21.15.57:0/3272187982 >> 172.21.15.57:0/3272187982 conn(0x7f3a3006da50 msgr2=0x7f3a3006fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:48.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.516+0000 7f3a35d51700 1 -- 172.21.15.57:0/3272187982 shutdown_connections 2023-03-03T07:43:48.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.516+0000 7f3a35d51700 1 -- 172.21.15.57:0/3272187982 wait complete. 2023-03-03T07:43:48.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.520+0000 7f3a35d51700 1 Processor -- start 2023-03-03T07:43:48.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.520+0000 7f3a35d51700 1 -- start start 2023-03-03T07:43:48.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.524+0000 7f3a35d51700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a3008aa80 0x7f3a3011ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:48.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.524+0000 7f3a35d51700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a30121320 con 0x7f3a3008aa80 2023-03-03T07:43:48.529 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.524+0000 7f3a34d4f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a3008aa80 0x7f3a3011ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:48.529 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.524+0000 7f3a34d4f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a3008aa80 0x7f3a3011ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35824/0 (socket says 172.21.15.57:35824) 2023-03-03T07:43:48.529 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.524+0000 7f3a34d4f700 1 -- 172.21.15.57:0/332880636 learned_addr learned my addr 172.21.15.57:0/332880636 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:48.529 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.524+0000 7f3a34d4f700 1 -- 172.21.15.57:0/332880636 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a200094b0 con 0x7f3a3008aa80 2023-03-03T07:43:48.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.524+0000 7f3a34d4f700 1 --2- 172.21.15.57:0/332880636 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a3008aa80 0x7f3a3011ec80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c00cfc0 tx=0x7f3a2c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:48.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.524+0000 7f3a257fa700 1 -- 172.21.15.57:0/332880636 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a2c005de0 con 0x7f3a3008aa80 2023-03-03T07:43:48.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.524+0000 7f3a35d51700 1 -- 172.21.15.57:0/332880636 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a3012d860 con 0x7f3a3008aa80 2023-03-03T07:43:48.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.524+0000 7f3a257fa700 1 -- 172.21.15.57:0/332880636 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a2c00a950 con 0x7f3a3008aa80 2023-03-03T07:43:48.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.524+0000 7f3a257fa700 1 -- 172.21.15.57:0/332880636 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a2c00ac30 con 0x7f3a3008aa80 2023-03-03T07:43:48.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.524+0000 7f3a35d51700 1 -- 172.21.15.57:0/332880636 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a3012d6d0 con 0x7f3a3008aa80 2023-03-03T07:43:48.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.528+0000 7f3a35d51700 1 -- 172.21.15.57:0/332880636 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a3012d9f0 con 0x7f3a3008aa80 2023-03-03T07:43:48.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.528+0000 7f3a257fa700 1 -- 172.21.15.57:0/332880636 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42205+0+0 (secure 0 0 0) 0x7f3a2c010070 con 0x7f3a3008aa80 2023-03-03T07:43:48.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.528+0000 7f3a257fa700 1 --2- 172.21.15.57:0/332880636 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f3a1c0347f0 0x7f3a1c036ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:48.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.528+0000 7f3a257fa700 1 -- 172.21.15.57:0/332880636 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2928+0+0 (secure 0 0 0) 0x7f3a2c046230 con 0x7f3a3008aa80 2023-03-03T07:43:48.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.528+0000 7f3a27fff700 1 --2- 172.21.15.57:0/332880636 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f3a1c0347f0 0x7f3a1c036ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:48.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.532+0000 7f3a27fff700 1 --2- 172.21.15.57:0/332880636 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f3a1c0347f0 0x7f3a1c036ca0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3a20014040 tx=0x7f3a20010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:48.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.536+0000 7f3a257fa700 1 -- 172.21.15.57:0/332880636 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f3a2c019710 con 0x7f3a3008aa80 2023-03-03T07:43:48.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.720+0000 7f3a35d51700 1 -- 172.21.15.57:0/332880636 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3a30121470 con 0x7f3a3008aa80 2023-03-03T07:43:48.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.720+0000 7f3a257fa700 1 -- 172.21.15.57:0/332880636 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3a2c0113a0 con 0x7f3a3008aa80 2023-03-03T07:43:48.725 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-03-03T07:43:48.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.724+0000 7f3a35d51700 1 -- 172.21.15.57:0/332880636 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f3a1c0347f0 msgr2=0x7f3a1c036ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:48.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.724+0000 7f3a35d51700 1 --2- 172.21.15.57:0/332880636 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f3a1c0347f0 0x7f3a1c036ca0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3a20014040 tx=0x7f3a20010000 comp rx=0 tx=0).stop 2023-03-03T07:43:48.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.724+0000 7f3a35d51700 1 -- 172.21.15.57:0/332880636 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a3008aa80 msgr2=0x7f3a3011ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:48.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.724+0000 7f3a35d51700 1 --2- 172.21.15.57:0/332880636 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a3008aa80 0x7f3a3011ec80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c00cfc0 tx=0x7f3a2c00a340 comp rx=0 tx=0).stop 2023-03-03T07:43:48.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.724+0000 7f3a35d51700 1 -- 172.21.15.57:0/332880636 shutdown_connections 2023-03-03T07:43:48.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.724+0000 7f3a35d51700 1 --2- 172.21.15.57:0/332880636 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f3a1c0347f0 0x7f3a1c036ca0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:48.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.724+0000 7f3a35d51700 1 --2- 172.21.15.57:0/332880636 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a3008aa80 0x7f3a3011ec80 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:48.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.724+0000 7f3a35d51700 1 -- 172.21.15.57:0/332880636 >> 172.21.15.57:0/332880636 conn(0x7f3a3006da50 msgr2=0x7f3a3006ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:48.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.724+0000 7f3a35d51700 1 -- 172.21.15.57:0/332880636 shutdown_connections 2023-03-03T07:43:48.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.724+0000 7f3a35d51700 1 -- 172.21.15.57:0/332880636 wait complete. 2023-03-03T07:43:48.763 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-03T07:43:48.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.964+0000 7faafb59e700 1 Processor -- start 2023-03-03T07:43:48.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.964+0000 7faafb59e700 1 -- start start 2023-03-03T07:43:48.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.964+0000 7faafb59e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7faafc08aa80 0x7faafc12d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:48.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.964+0000 7faafb59e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faafc08c0d0 con 0x7faafc096cd0 2023-03-03T07:43:48.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.968+0000 7faafb59e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faafc08c3e0 con 0x7faafc08aa80 2023-03-03T07:43:48.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.968+0000 7faafa59c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7faafc096cd0 0x7faafc08a370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56930/0 (socket says 172.21.15.57:56930) 2023-03-03T07:43:48.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.968+0000 7faafa59c700 1 -- 172.21.15.57:0/3943396685 learned_addr learned my addr 172.21.15.57:0/3943396685 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:43:48.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.968+0000 7faaf9d9b700 1 --2- 172.21.15.57:0/3943396685 >> v2:172.21.15.57:3300/0 conn(0x7faafc08aa80 0x7faafc12d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:48.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.968+0000 7faaf959a700 1 -- 172.21.15.57:0/3943396685 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 952047022 0 0) 0x7faafc08c0d0 con 0x7faafc096cd0 2023-03-03T07:43:48.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.968+0000 7faaf959a700 1 -- 172.21.15.57:0/3943396685 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faae40035d0 con 0x7faafc096cd0 2023-03-03T07:43:48.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.968+0000 7faaf9d9b700 1 -- 172.21.15.57:0/3943396685 >> v1:172.21.15.57:6789/0 conn(0x7faafc096cd0 legacy=0x7faafc08a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:48.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.968+0000 7faaf9d9b700 1 -- 172.21.15.57:0/3943396685 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faafc08ae90 con 0x7faafc08aa80 2023-03-03T07:43:48.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.968+0000 7faaf9d9b700 1 --2- 172.21.15.57:0/3943396685 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faafc08aa80 0x7faafc12d190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7faaf00097d0 tx=0x7faaf0009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae42936f70b36cab server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:48.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.968+0000 7faaf959a700 1 -- 172.21.15.57:0/3943396685 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faaf0004160 con 0x7faafc08aa80 2023-03-03T07:43:48.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.968+0000 7faaf959a700 1 -- 172.21.15.57:0/3943396685 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf00042c0 con 0x7faafc08aa80 2023-03-03T07:43:48.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.968+0000 7faaf959a700 1 -- 172.21.15.57:0/3943396685 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faaf00045a0 con 0x7faafc08aa80 2023-03-03T07:43:48.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.972+0000 7faafb59e700 1 -- 172.21.15.57:0/3943396685 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faafc08aa80 msgr2=0x7faafc12d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:48.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.972+0000 7faafb59e700 1 --2- 172.21.15.57:0/3943396685 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faafc08aa80 0x7faafc12d190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7faaf00097d0 tx=0x7faaf0009ae0 comp rx=0 tx=0).stop 2023-03-03T07:43:48.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.972+0000 7faafb59e700 1 -- 172.21.15.57:0/3943396685 shutdown_connections 2023-03-03T07:43:48.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.972+0000 7faafb59e700 1 --2- 172.21.15.57:0/3943396685 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faafc08aa80 0x7faafc12d190 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:48.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.972+0000 7faafb59e700 1 -- 172.21.15.57:0/3943396685 >> 172.21.15.57:0/3943396685 conn(0x7faafc06da50 msgr2=0x7faafc06fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:48.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.972+0000 7faafb59e700 1 -- 172.21.15.57:0/3943396685 shutdown_connections 2023-03-03T07:43:48.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.972+0000 7faafb59e700 1 -- 172.21.15.57:0/3943396685 wait complete. 2023-03-03T07:43:48.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.976+0000 7faafb59e700 1 Processor -- start 2023-03-03T07:43:48.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.976+0000 7faafb59e700 1 -- start start 2023-03-03T07:43:48.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.976+0000 7faafb59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faafc08aa80 0x7faafc1bb920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:48.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.976+0000 7faafb59e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faafc11c6e0 con 0x7faafc08aa80 2023-03-03T07:43:48.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.976+0000 7faafa59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faafc08aa80 0x7faafc1bb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:48.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.976+0000 7faafa59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faafc08aa80 0x7faafc1bb920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35844/0 (socket says 172.21.15.57:35844) 2023-03-03T07:43:48.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.976+0000 7faafa59c700 1 -- 172.21.15.57:0/3055898656 learned_addr learned my addr 172.21.15.57:0/3055898656 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:48.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.976+0000 7faafa59c700 1 -- 172.21.15.57:0/3055898656 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf00094b0 con 0x7faafc08aa80 2023-03-03T07:43:48.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.980+0000 7faafa59c700 1 --2- 172.21.15.57:0/3055898656 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faafc08aa80 0x7faafc1bb920 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7faaec001260 tx=0x7faaec00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:48.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.980+0000 7faaeaffd700 1 -- 172.21.15.57:0/3055898656 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faaec007410 con 0x7faafc08aa80 2023-03-03T07:43:48.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.980+0000 7faaeaffd700 1 -- 172.21.15.57:0/3055898656 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaec007570 con 0x7faafc08aa80 2023-03-03T07:43:48.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.980+0000 7faaeaffd700 1 -- 172.21.15.57:0/3055898656 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faaec005850 con 0x7faafc08aa80 2023-03-03T07:43:48.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.980+0000 7faafb59e700 1 -- 172.21.15.57:0/3055898656 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faafc12d860 con 0x7faafc08aa80 2023-03-03T07:43:48.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.980+0000 7faafb59e700 1 -- 172.21.15.57:0/3055898656 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faafc12d6d0 con 0x7faafc08aa80 2023-03-03T07:43:48.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.980+0000 7faafb59e700 1 -- 172.21.15.57:0/3055898656 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faafc12d9f0 con 0x7faafc08aa80 2023-03-03T07:43:48.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.980+0000 7faaeaffd700 1 -- 172.21.15.57:0/3055898656 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42205+0+0 (secure 0 0 0) 0x7faaec019030 con 0x7faafc08aa80 2023-03-03T07:43:48.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.980+0000 7faaeaffd700 1 --2- 172.21.15.57:0/3055898656 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7faadc034840 0x7faadc036cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:48.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.984+0000 7faaeaffd700 1 -- 172.21.15.57:0/3055898656 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2928+0+0 (secure 0 0 0) 0x7faaec0454d0 con 0x7faafc08aa80 2023-03-03T07:43:48.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.984+0000 7faaf9d9b700 1 --2- 172.21.15.57:0/3055898656 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7faadc034840 0x7faadc036cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:48.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.984+0000 7faaf9d9b700 1 --2- 172.21.15.57:0/3055898656 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7faadc034840 0x7faadc036cf0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7faaf0006ee0 tx=0x7faaf0008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:48.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:48.988+0000 7faaeaffd700 1 -- 172.21.15.57:0/3055898656 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7faaec0198b0 con 0x7faafc08aa80 2023-03-03T07:43:49.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.164+0000 7faafb59e700 1 -- 172.21.15.57:0/3055898656 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7faafc0619b0 con 0x7faafc08aa80 2023-03-03T07:43:49.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.164+0000 7faaeaffd700 1 -- 172.21.15.57:0/3055898656 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7faaec017030 con 0x7faafc08aa80 2023-03-03T07:43:49.169 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2023-03-03T07:43:49.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.168+0000 7faafb59e700 1 -- 172.21.15.57:0/3055898656 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7faadc034840 msgr2=0x7faadc036cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:49.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.168+0000 7faafb59e700 1 --2- 172.21.15.57:0/3055898656 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7faadc034840 0x7faadc036cf0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7faaf0006ee0 tx=0x7faaf0008030 comp rx=0 tx=0).stop 2023-03-03T07:43:49.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.168+0000 7faafb59e700 1 -- 172.21.15.57:0/3055898656 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faafc08aa80 msgr2=0x7faafc1bb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:49.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.168+0000 7faafb59e700 1 --2- 172.21.15.57:0/3055898656 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faafc08aa80 0x7faafc1bb920 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7faaec001260 tx=0x7faaec00ca10 comp rx=0 tx=0).stop 2023-03-03T07:43:49.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.168+0000 7faafb59e700 1 -- 172.21.15.57:0/3055898656 shutdown_connections 2023-03-03T07:43:49.173 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.168+0000 7faafb59e700 1 --2- 172.21.15.57:0/3055898656 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7faadc034840 0x7faadc036cf0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:49.173 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.168+0000 7faafb59e700 1 --2- 172.21.15.57:0/3055898656 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faafc08aa80 0x7faafc1bb920 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:49.173 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.168+0000 7faafb59e700 1 -- 172.21.15.57:0/3055898656 >> 172.21.15.57:0/3055898656 conn(0x7faafc06da50 msgr2=0x7faafc12c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:49.173 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.168+0000 7faafb59e700 1 -- 172.21.15.57:0/3055898656 shutdown_connections 2023-03-03T07:43:49.173 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.168+0000 7faafb59e700 1 -- 172.21.15.57:0/3055898656 wait complete. 2023-03-03T07:43:49.206 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-03T07:43:49.423 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.416+0000 7fcd6aadc700 1 Processor -- start 2023-03-03T07:43:49.423 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.416+0000 7fcd6aadc700 1 -- start start 2023-03-03T07:43:49.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.420+0000 7fcd6aadc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcd6408abd0 0x7fcd6412a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:49.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.420+0000 7fcd6aadc700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd6408c990 con 0x7fcd6406a790 2023-03-03T07:43:49.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.420+0000 7fcd6aadc700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd6408ba50 con 0x7fcd6408abd0 2023-03-03T07:43:49.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.420+0000 7fcd692d9700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcd6408abd0 0x7fcd6412a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:49.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.420+0000 7fcd69ada700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fcd6406a790 0x7fcd6408a4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56936/0 (socket says 172.21.15.57:56936) 2023-03-03T07:43:49.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.420+0000 7fcd692d9700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcd6408abd0 0x7fcd6412a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35854/0 (socket says 172.21.15.57:35854) 2023-03-03T07:43:49.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.420+0000 7fcd69ada700 1 -- 172.21.15.57:0/2340052107 learned_addr learned my addr 172.21.15.57:0/2340052107 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:43:49.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.420+0000 7fcd692d9700 1 -- 172.21.15.57:0/2340052107 >> v1:172.21.15.57:6789/0 conn(0x7fcd6406a790 legacy=0x7fcd6408a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:49.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.420+0000 7fcd692d9700 1 -- 172.21.15.57:0/2340052107 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd6408cca0 con 0x7fcd6408abd0 2023-03-03T07:43:49.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.420+0000 7fcd692d9700 1 --2- 172.21.15.57:0/2340052107 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd6408abd0 0x7fcd6412a260 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fcd540097d0 tx=0x7fcd54009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18cd016212f7e76b server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:49.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.420+0000 7fcd68ad8700 1 -- 172.21.15.57:0/2340052107 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcd540041c0 con 0x7fcd6408abd0 2023-03-03T07:43:49.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.420+0000 7fcd68ad8700 1 -- 172.21.15.57:0/2340052107 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd54004320 con 0x7fcd6408abd0 2023-03-03T07:43:49.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.420+0000 7fcd68ad8700 1 -- 172.21.15.57:0/2340052107 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcd540036c0 con 0x7fcd6408abd0 2023-03-03T07:43:49.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.424+0000 7fcd6aadc700 1 -- 172.21.15.57:0/2340052107 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd6408abd0 msgr2=0x7fcd6412a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:49.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.424+0000 7fcd6aadc700 1 --2- 172.21.15.57:0/2340052107 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd6408abd0 0x7fcd6412a260 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fcd540097d0 tx=0x7fcd54009ae0 comp rx=0 tx=0).stop 2023-03-03T07:43:49.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.424+0000 7fcd6aadc700 1 -- 172.21.15.57:0/2340052107 shutdown_connections 2023-03-03T07:43:49.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.424+0000 7fcd6aadc700 1 --2- 172.21.15.57:0/2340052107 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd6408abd0 0x7fcd6412a260 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:49.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.424+0000 7fcd6aadc700 1 -- 172.21.15.57:0/2340052107 >> 172.21.15.57:0/2340052107 conn(0x7fcd6406da50 msgr2=0x7fcd6406fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:49.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.424+0000 7fcd6aadc700 1 -- 172.21.15.57:0/2340052107 shutdown_connections 2023-03-03T07:43:49.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.424+0000 7fcd6aadc700 1 -- 172.21.15.57:0/2340052107 wait complete. 2023-03-03T07:43:49.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.428+0000 7fcd6aadc700 1 Processor -- start 2023-03-03T07:43:49.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.428+0000 7fcd6aadc700 1 -- start start 2023-03-03T07:43:49.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.428+0000 7fcd6aadc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd6406a790 0x7fcd64121340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:49.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.428+0000 7fcd6aadc700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd64122be0 con 0x7fcd6406a790 2023-03-03T07:43:49.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.428+0000 7fcd69ada700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd6406a790 0x7fcd64121340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:49.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.428+0000 7fcd69ada700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd6406a790 0x7fcd64121340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52070/0 (socket says 172.21.15.57:52070) 2023-03-03T07:43:49.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.428+0000 7fcd69ada700 1 -- 172.21.15.57:0/1566094191 learned_addr learned my addr 172.21.15.57:0/1566094191 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:49.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.428+0000 7fcd69ada700 1 -- 172.21.15.57:0/1566094191 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd540094b0 con 0x7fcd6406a790 2023-03-03T07:43:49.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.428+0000 7fcd69ada700 1 --2- 172.21.15.57:0/1566094191 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd6406a790 0x7fcd64121340 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcd6000cb10 tx=0x7fcd6000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:49.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.428+0000 7fcd5a7fc700 1 -- 172.21.15.57:0/1566094191 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcd6000a6d0 con 0x7fcd6406a790 2023-03-03T07:43:49.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.428+0000 7fcd5a7fc700 1 -- 172.21.15.57:0/1566094191 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd6000a830 con 0x7fcd6406a790 2023-03-03T07:43:49.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.428+0000 7fcd5a7fc700 1 -- 172.21.15.57:0/1566094191 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcd6000aad0 con 0x7fcd6406a790 2023-03-03T07:43:49.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.428+0000 7fcd6aadc700 1 -- 172.21.15.57:0/1566094191 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd6408b050 con 0x7fcd6406a790 2023-03-03T07:43:49.436 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.432+0000 7fcd6aadc700 1 -- 172.21.15.57:0/1566094191 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd64096dc0 con 0x7fcd6406a790 2023-03-03T07:43:49.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.432+0000 7fcd6aadc700 1 -- 172.21.15.57:0/1566094191 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd6408b1e0 con 0x7fcd6406a790 2023-03-03T07:43:49.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.432+0000 7fcd5a7fc700 1 -- 172.21.15.57:0/1566094191 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42205+0+0 (secure 0 0 0) 0x7fcd60010070 con 0x7fcd6406a790 2023-03-03T07:43:49.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.436+0000 7fcd5a7fc700 1 --2- 172.21.15.57:0/1566094191 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fcd48034840 0x7fcd48036cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:49.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.436+0000 7fcd5a7fc700 1 -- 172.21.15.57:0/1566094191 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2928+0+0 (secure 0 0 0) 0x7fcd600460a0 con 0x7fcd6406a790 2023-03-03T07:43:49.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.436+0000 7fcd692d9700 1 --2- 172.21.15.57:0/1566094191 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fcd48034840 0x7fcd48036cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:49.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.436+0000 7fcd692d9700 1 --2- 172.21.15.57:0/1566094191 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fcd48034840 0x7fcd48036cf0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcd54014040 tx=0x7fcd54010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:49.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.444+0000 7fcd5a7fc700 1 -- 172.21.15.57:0/1566094191 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fcd60076400 con 0x7fcd6406a790 2023-03-03T07:43:49.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.620+0000 7fcd6aadc700 1 -- 172.21.15.57:0/1566094191 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcd64123a40 con 0x7fcd6406a790 2023-03-03T07:43:49.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.624+0000 7fcd5a7fc700 1 -- 172.21.15.57:0/1566094191 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v16) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcd60010710 con 0x7fcd6406a790 2023-03-03T07:43:49.628 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2023-03-03T07:43:49.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.624+0000 7fcd6aadc700 1 -- 172.21.15.57:0/1566094191 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fcd48034840 msgr2=0x7fcd48036cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:49.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.624+0000 7fcd6aadc700 1 --2- 172.21.15.57:0/1566094191 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fcd48034840 0x7fcd48036cf0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcd54014040 tx=0x7fcd54010000 comp rx=0 tx=0).stop 2023-03-03T07:43:49.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.624+0000 7fcd6aadc700 1 -- 172.21.15.57:0/1566094191 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd6406a790 msgr2=0x7fcd64121340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:49.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.624+0000 7fcd6aadc700 1 --2- 172.21.15.57:0/1566094191 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd6406a790 0x7fcd64121340 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcd6000cb10 tx=0x7fcd6000cbf0 comp rx=0 tx=0).stop 2023-03-03T07:43:49.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.624+0000 7fcd6aadc700 1 -- 172.21.15.57:0/1566094191 shutdown_connections 2023-03-03T07:43:49.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.624+0000 7fcd6aadc700 1 --2- 172.21.15.57:0/1566094191 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fcd48034840 0x7fcd48036cf0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:49.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.624+0000 7fcd6aadc700 1 --2- 172.21.15.57:0/1566094191 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd6406a790 0x7fcd64121340 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:49.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.624+0000 7fcd6aadc700 1 -- 172.21.15.57:0/1566094191 >> 172.21.15.57:0/1566094191 conn(0x7fcd6406da50 msgr2=0x7fcd64070120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:49.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.624+0000 7fcd6aadc700 1 -- 172.21.15.57:0/1566094191 shutdown_connections 2023-03-03T07:43:49.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.624+0000 7fcd6aadc700 1 -- 172.21.15.57:0/1566094191 wait complete. 2023-03-03T07:43:49.659 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-03T07:43:49.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.872+0000 7fceb96d8700 1 Processor -- start 2023-03-03T07:43:49.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.872+0000 7fceb96d8700 1 -- start start 2023-03-03T07:43:49.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.876+0000 7fceb96d8700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fceb4121cd0 0x7fceb4089f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:49.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.876+0000 7fceb96d8700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceb408b520 con 0x7fceb41220a0 2023-03-03T07:43:49.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.876+0000 7fceb96d8700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceb4121530 con 0x7fceb4121cd0 2023-03-03T07:43:49.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.876+0000 7fceb2ffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fceb4121cd0 0x7fceb4089f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:49.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.876+0000 7fceb2ffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fceb4121cd0 0x7fceb4089f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52076/0 (socket says 172.21.15.57:52076) 2023-03-03T07:43:49.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.876+0000 7fceb2ffd700 1 -- 172.21.15.57:0/296585497 learned_addr learned my addr 172.21.15.57:0/296585497 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:49.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.876+0000 7fceb1ffb700 1 -- 172.21.15.57:0/296585497 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2846670318 0 0) 0x7fceb408b520 con 0x7fceb41220a0 2023-03-03T07:43:49.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.876+0000 7fceb2ffd700 1 -- 172.21.15.57:0/296585497 >> v1:172.21.15.57:6789/0 conn(0x7fceb41220a0 legacy=0x7fceb408a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:49.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.876+0000 7fceb2ffd700 1 -- 172.21.15.57:0/296585497 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb41216a0 con 0x7fceb4121cd0 2023-03-03T07:43:49.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.876+0000 7fceb2ffd700 1 --2- 172.21.15.57:0/296585497 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fceb4121cd0 0x7fceb4089f80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcea400aa30 tx=0x7fcea400ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=515c64c6cc485094 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:49.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.880+0000 7fceb1ffb700 1 -- 172.21.15.57:0/296585497 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcea400caa0 con 0x7fceb4121cd0 2023-03-03T07:43:49.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.880+0000 7fceb1ffb700 1 -- 172.21.15.57:0/296585497 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea400cc00 con 0x7fceb4121cd0 2023-03-03T07:43:49.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.880+0000 7fceb1ffb700 1 -- 172.21.15.57:0/296585497 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcea4004030 con 0x7fceb4121cd0 2023-03-03T07:43:49.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.880+0000 7fceb96d8700 1 -- 172.21.15.57:0/296585497 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fceb4121cd0 msgr2=0x7fceb4089f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:49.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.880+0000 7fceb96d8700 1 --2- 172.21.15.57:0/296585497 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fceb4121cd0 0x7fceb4089f80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcea400aa30 tx=0x7fcea400ad40 comp rx=0 tx=0).stop 2023-03-03T07:43:49.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.880+0000 7fceb96d8700 1 -- 172.21.15.57:0/296585497 shutdown_connections 2023-03-03T07:43:49.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.880+0000 7fceb96d8700 1 --2- 172.21.15.57:0/296585497 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fceb4121cd0 0x7fceb4089f80 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:49.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.880+0000 7fceb96d8700 1 -- 172.21.15.57:0/296585497 >> 172.21.15.57:0/296585497 conn(0x7fceb4069f00 msgr2=0x7fceb406a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:49.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.880+0000 7fceb96d8700 1 -- 172.21.15.57:0/296585497 shutdown_connections 2023-03-03T07:43:49.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.880+0000 7fceb96d8700 1 -- 172.21.15.57:0/296585497 wait complete. 2023-03-03T07:43:49.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.880+0000 7fceb96d8700 1 Processor -- start 2023-03-03T07:43:49.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.880+0000 7fceb96d8700 1 -- start start 2023-03-03T07:43:49.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.884+0000 7fceb96d8700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fceb4121cd0 0x7fceb408c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:49.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.884+0000 7fceb96d8700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb408df80 con 0x7fceb4121cd0 2023-03-03T07:43:49.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.884+0000 7fceb2ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fceb4121cd0 0x7fceb408c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:49.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.884+0000 7fceb2ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fceb4121cd0 0x7fceb408c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52086/0 (socket says 172.21.15.57:52086) 2023-03-03T07:43:49.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.884+0000 7fceb2ffd700 1 -- 172.21.15.57:0/994297476 learned_addr learned my addr 172.21.15.57:0/994297476 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:49.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.884+0000 7fceb2ffd700 1 -- 172.21.15.57:0/994297476 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea400a710 con 0x7fceb4121cd0 2023-03-03T07:43:49.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.884+0000 7fceb2ffd700 1 --2- 172.21.15.57:0/994297476 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fceb4121cd0 0x7fceb408c550 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fceb4121670 tx=0x7fcea4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:49.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.884+0000 7fce9b7fe700 1 -- 172.21.15.57:0/994297476 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcea401d070 con 0x7fceb4121cd0 2023-03-03T07:43:49.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.884+0000 7fce9b7fe700 1 -- 172.21.15.57:0/994297476 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea4003bb0 con 0x7fceb4121cd0 2023-03-03T07:43:49.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.884+0000 7fceb96d8700 1 -- 172.21.15.57:0/994297476 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceb408ad60 con 0x7fceb4121cd0 2023-03-03T07:43:49.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.884+0000 7fce9b7fe700 1 -- 172.21.15.57:0/994297476 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcea4003e50 con 0x7fceb4121cd0 2023-03-03T07:43:49.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.884+0000 7fceb96d8700 1 -- 172.21.15.57:0/994297476 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceb408abd0 con 0x7fceb4121cd0 2023-03-03T07:43:49.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.888+0000 7fce9b7fe700 1 -- 172.21.15.57:0/994297476 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42205+0+0 (secure 0 0 0) 0x7fcea4028030 con 0x7fceb4121cd0 2023-03-03T07:43:49.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.888+0000 7fceb96d8700 1 -- 172.21.15.57:0/994297476 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceb4094700 con 0x7fceb4121cd0 2023-03-03T07:43:49.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.888+0000 7fce9b7fe700 1 --2- 172.21.15.57:0/994297476 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fcea0034790 0x7fcea0036c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:49.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.888+0000 7fce9b7fe700 1 -- 172.21.15.57:0/994297476 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2928+0+0 (secure 0 0 0) 0x7fcea4047800 con 0x7fceb4121cd0 2023-03-03T07:43:49.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.888+0000 7fceb27fc700 1 --2- 172.21.15.57:0/994297476 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fcea0034790 0x7fcea0036c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:49.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.888+0000 7fceb27fc700 1 --2- 172.21.15.57:0/994297476 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fcea0034790 0x7fcea0036c40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fcea8001190 tx=0x7fcea80079b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:49.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:49.896+0000 7fce9b7fe700 1 -- 172.21.15.57:0/994297476 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fcea4021410 con 0x7fceb4121cd0 2023-03-03T07:43:50.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.072+0000 7fceb96d8700 1 -- 172.21.15.57:0/994297476 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fceb408ee70 con 0x7fceb4121cd0 2023-03-03T07:43:50.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.072+0000 7fce9b7fe700 1 -- 172.21.15.57:0/994297476 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v16) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcea4026030 con 0x7fceb4121cd0 2023-03-03T07:43:50.078 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2023-03-03T07:43:50.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.076+0000 7fceb96d8700 1 -- 172.21.15.57:0/994297476 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fcea0034790 msgr2=0x7fcea0036c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:50.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.076+0000 7fceb96d8700 1 --2- 172.21.15.57:0/994297476 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fcea0034790 0x7fcea0036c40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fcea8001190 tx=0x7fcea80079b0 comp rx=0 tx=0).stop 2023-03-03T07:43:50.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.076+0000 7fceb96d8700 1 -- 172.21.15.57:0/994297476 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fceb4121cd0 msgr2=0x7fceb408c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:50.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.076+0000 7fceb96d8700 1 --2- 172.21.15.57:0/994297476 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fceb4121cd0 0x7fceb408c550 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fceb4121670 tx=0x7fcea4004770 comp rx=0 tx=0).stop 2023-03-03T07:43:50.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.076+0000 7fceb96d8700 1 -- 172.21.15.57:0/994297476 shutdown_connections 2023-03-03T07:43:50.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.076+0000 7fceb96d8700 1 --2- 172.21.15.57:0/994297476 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fcea0034790 0x7fcea0036c40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:50.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.076+0000 7fceb96d8700 1 --2- 172.21.15.57:0/994297476 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fceb4121cd0 0x7fceb408c550 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:50.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.076+0000 7fceb96d8700 1 -- 172.21.15.57:0/994297476 >> 172.21.15.57:0/994297476 conn(0x7fceb4069f00 msgr2=0x7fceb406e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:50.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.076+0000 7fceb96d8700 1 -- 172.21.15.57:0/994297476 shutdown_connections 2023-03-03T07:43:50.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.076+0000 7fceb96d8700 1 -- 172.21.15.57:0/994297476 wait complete. 2023-03-03T07:43:50.112 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-03T07:43:50.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.316+0000 7fb7ce8c4700 1 Processor -- start 2023-03-03T07:43:50.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.316+0000 7fb7ce8c4700 1 -- start start 2023-03-03T07:43:50.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.316+0000 7fb7ce8c4700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb7c812a550 0x7fb7c808a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:50.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.316+0000 7fb7ce8c4700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7c812a9f0 con 0x7fb7c812a180 2023-03-03T07:43:50.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.316+0000 7fb7ce8c4700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7c808b4f0 con 0x7fb7c812a550 2023-03-03T07:43:50.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.316+0000 7fb7cd0c1700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb7c812a550 0x7fb7c808a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:50.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.316+0000 7fb7cd0c1700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb7c812a550 0x7fb7c808a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52102/0 (socket says 172.21.15.57:52102) 2023-03-03T07:43:50.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.316+0000 7fb7cd0c1700 1 -- 172.21.15.57:0/345213074 learned_addr learned my addr 172.21.15.57:0/345213074 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:50.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.316+0000 7fb7cd0c1700 1 -- 172.21.15.57:0/345213074 >> v1:172.21.15.57:6789/0 conn(0x7fb7c812a180 legacy=0x7fb7c8089f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:50.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.316+0000 7fb7cd0c1700 1 -- 172.21.15.57:0/345213074 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c8129b80 con 0x7fb7c812a550 2023-03-03T07:43:50.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.316+0000 7fb7cd0c1700 1 --2- 172.21.15.57:0/345213074 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7c812a550 0x7fb7c808a690 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb7b8009890 tx=0x7fb7b8009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ce437876263256d server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:50.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.320+0000 7fb7cc8c0700 1 -- 172.21.15.57:0/345213074 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb7b8004160 con 0x7fb7c812a550 2023-03-03T07:43:50.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.320+0000 7fb7cc8c0700 1 -- 172.21.15.57:0/345213074 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7b80042c0 con 0x7fb7c812a550 2023-03-03T07:43:50.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.320+0000 7fb7cc8c0700 1 -- 172.21.15.57:0/345213074 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb7b8004580 con 0x7fb7c812a550 2023-03-03T07:43:50.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.320+0000 7fb7ce8c4700 1 -- 172.21.15.57:0/345213074 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7c812a550 msgr2=0x7fb7c808a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:50.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.320+0000 7fb7ce8c4700 1 --2- 172.21.15.57:0/345213074 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7c812a550 0x7fb7c808a690 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb7b8009890 tx=0x7fb7b8009ba0 comp rx=0 tx=0).stop 2023-03-03T07:43:50.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.320+0000 7fb7ce8c4700 1 -- 172.21.15.57:0/345213074 shutdown_connections 2023-03-03T07:43:50.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.320+0000 7fb7ce8c4700 1 --2- 172.21.15.57:0/345213074 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7c812a550 0x7fb7c808a690 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:50.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.320+0000 7fb7ce8c4700 1 -- 172.21.15.57:0/345213074 >> 172.21.15.57:0/345213074 conn(0x7fb7c806c840 msgr2=0x7fb7c806ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:50.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.320+0000 7fb7ce8c4700 1 -- 172.21.15.57:0/345213074 shutdown_connections 2023-03-03T07:43:50.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.320+0000 7fb7ce8c4700 1 -- 172.21.15.57:0/345213074 wait complete. 2023-03-03T07:43:50.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.324+0000 7fb7ce8c4700 1 Processor -- start 2023-03-03T07:43:50.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.324+0000 7fb7ce8c4700 1 -- start start 2023-03-03T07:43:50.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.324+0000 7fb7ce8c4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7c812a180 0x7fb7c81c03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:50.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.324+0000 7fb7ce8c4700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c808c0c0 con 0x7fb7c812a180 2023-03-03T07:43:50.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.324+0000 7fb7cd8c2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7c812a180 0x7fb7c81c03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:50.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.324+0000 7fb7cd8c2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7c812a180 0x7fb7c81c03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52104/0 (socket says 172.21.15.57:52104) 2023-03-03T07:43:50.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.324+0000 7fb7cd8c2700 1 -- 172.21.15.57:0/917476614 learned_addr learned my addr 172.21.15.57:0/917476614 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:50.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.328+0000 7fb7cd8c2700 1 -- 172.21.15.57:0/917476614 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b8009570 con 0x7fb7c812a180 2023-03-03T07:43:50.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.328+0000 7fb7cd8c2700 1 --2- 172.21.15.57:0/917476614 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7c812a180 0x7fb7c81c03e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb7c400c480 tx=0x7fb7c400c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:50.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.328+0000 7fb7be7fc700 1 -- 172.21.15.57:0/917476614 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb7c4005150 con 0x7fb7c812a180 2023-03-03T07:43:50.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.328+0000 7fb7be7fc700 1 -- 172.21.15.57:0/917476614 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7c40052b0 con 0x7fb7c812a180 2023-03-03T07:43:50.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.328+0000 7fb7be7fc700 1 -- 172.21.15.57:0/917476614 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb7c4005590 con 0x7fb7c812a180 2023-03-03T07:43:50.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.328+0000 7fb7ce8c4700 1 -- 172.21.15.57:0/917476614 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7c808ad60 con 0x7fb7c812a180 2023-03-03T07:43:50.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.328+0000 7fb7ce8c4700 1 -- 172.21.15.57:0/917476614 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7c808abd0 con 0x7fb7c812a180 2023-03-03T07:43:50.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.328+0000 7fb7be7fc700 1 -- 172.21.15.57:0/917476614 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42205+0+0 (secure 0 0 0) 0x7fb7c4010050 con 0x7fb7c812a180 2023-03-03T07:43:50.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.328+0000 7fb7ce8c4700 1 -- 172.21.15.57:0/917476614 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7c8132020 con 0x7fb7c812a180 2023-03-03T07:43:50.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.332+0000 7fb7be7fc700 1 --2- 172.21.15.57:0/917476614 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fb7ac0347f0 0x7fb7ac036ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:50.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.332+0000 7fb7be7fc700 1 -- 172.21.15.57:0/917476614 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2928+0+0 (secure 0 0 0) 0x7fb7c4045310 con 0x7fb7c812a180 2023-03-03T07:43:50.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.332+0000 7fb7cd0c1700 1 --2- 172.21.15.57:0/917476614 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fb7ac0347f0 0x7fb7ac036ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:50.338 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.332+0000 7fb7cd0c1700 1 --2- 172.21.15.57:0/917476614 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fb7ac0347f0 0x7fb7ac036ca0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb7b8009fd0 tx=0x7fb7b8008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:50.343 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.336+0000 7fb7be7fc700 1 -- 172.21.15.57:0/917476614 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb7c40106f0 con 0x7fb7c812a180 2023-03-03T07:43:50.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.552+0000 7fb7ce8c4700 1 -- 172.21.15.57:0/917476614 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb7c80619b0 con 0x7fb7c812a180 2023-03-03T07:43:50.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.552+0000 7fb7be7fc700 1 -- 172.21.15.57:0/917476614 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2375 (secure 0 0 0) 0x7fb7c401a3a0 con 0x7fb7c812a180 2023-03-03T07:43:50.557 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-03T07:43:50.557 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-03T07:43:36.355228+0000","modified":"2023-03-03T07:43:39.370352+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4134},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4134":{"gid":4134,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6811/2058274046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2058274046},{"type":"v1","addr":"172.21.15.57:6811","nonce":2058274046}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-03-03T07:43:50.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.556+0000 7fb7ce8c4700 1 -- 172.21.15.57:0/917476614 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fb7ac0347f0 msgr2=0x7fb7ac036ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:50.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.556+0000 7fb7ce8c4700 1 --2- 172.21.15.57:0/917476614 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fb7ac0347f0 0x7fb7ac036ca0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb7b8009fd0 tx=0x7fb7b8008030 comp rx=0 tx=0).stop 2023-03-03T07:43:50.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.556+0000 7fb7ce8c4700 1 -- 172.21.15.57:0/917476614 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7c812a180 msgr2=0x7fb7c81c03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:50.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.556+0000 7fb7ce8c4700 1 --2- 172.21.15.57:0/917476614 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7c812a180 0x7fb7c81c03e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb7c400c480 tx=0x7fb7c400c840 comp rx=0 tx=0).stop 2023-03-03T07:43:50.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.556+0000 7fb7ce8c4700 1 -- 172.21.15.57:0/917476614 shutdown_connections 2023-03-03T07:43:50.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.556+0000 7fb7ce8c4700 1 --2- 172.21.15.57:0/917476614 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fb7ac0347f0 0x7fb7ac036ca0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:50.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.556+0000 7fb7ce8c4700 1 --2- 172.21.15.57:0/917476614 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7c812a180 0x7fb7c81c03e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:50.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.556+0000 7fb7ce8c4700 1 -- 172.21.15.57:0/917476614 >> 172.21.15.57:0/917476614 conn(0x7fb7c806c840 msgr2=0x7fb7c8126860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:50.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.556+0000 7fb7ce8c4700 1 -- 172.21.15.57:0/917476614 shutdown_connections 2023-03-03T07:43:50.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.556+0000 7fb7ce8c4700 1 -- 172.21.15.57:0/917476614 wait complete. 2023-03-03T07:43:50.564 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 6 2023-03-03T07:43:50.693 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-03-03T07:43:36.355228+0000', 'modified': '2023-03-03T07:43:39.370352+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4134}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4134': {'gid': 4134, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.57:6811/2058274046', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6810', 'nonce': 2058274046}, {'type': 'v1', 'addr': '172.21.15.57:6811', 'nonce': 2058274046}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-03-03T07:43:50.694 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-03-03T07:43:50.694 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-03-03T07:43:50.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.900+0000 7f85957f9700 1 Processor -- start 2023-03-03T07:43:50.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.900+0000 7f85957f9700 1 -- start start 2023-03-03T07:43:50.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.900+0000 7f85957f9700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f85900992b0 0x7f8590099680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:50.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.900+0000 7f85957f9700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f859008f6a0 con 0x7f859008e390 2023-03-03T07:43:50.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.904+0000 7f85957f9700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8590072220 con 0x7f85900992b0 2023-03-03T07:43:50.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.904+0000 7f858ffff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f85900992b0 0x7f8590099680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:50.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.904+0000 7f858ffff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f85900992b0 0x7f8590099680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52110/0 (socket says 172.21.15.57:52110) 2023-03-03T07:43:50.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.904+0000 7f858ffff700 1 -- 172.21.15.57:0/1495549704 learned_addr learned my addr 172.21.15.57:0/1495549704 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:50.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.904+0000 7f858ffff700 1 -- 172.21.15.57:0/1495549704 >> v1:172.21.15.57:6789/0 conn(0x7f859008e390 legacy=0x7f859008e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:50.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.904+0000 7f858ffff700 1 -- 172.21.15.57:0/1495549704 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f859008f970 con 0x7f85900992b0 2023-03-03T07:43:50.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.904+0000 7f858ffff700 1 --2- 172.21.15.57:0/1495549704 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85900992b0 0x7f8590099680 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8580009890 tx=0x7f8580009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54b2ce6efb53d690 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:50.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.904+0000 7f858f7fe700 1 -- 172.21.15.57:0/1495549704 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8580004160 con 0x7f85900992b0 2023-03-03T07:43:50.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.904+0000 7f858f7fe700 1 -- 172.21.15.57:0/1495549704 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85800042c0 con 0x7f85900992b0 2023-03-03T07:43:50.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.904+0000 7f858f7fe700 1 -- 172.21.15.57:0/1495549704 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8580004580 con 0x7f85900992b0 2023-03-03T07:43:50.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.904+0000 7f85957f9700 1 -- 172.21.15.57:0/1495549704 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85900992b0 msgr2=0x7f8590099680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:50.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.904+0000 7f85957f9700 1 --2- 172.21.15.57:0/1495549704 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85900992b0 0x7f8590099680 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8580009890 tx=0x7f8580009ba0 comp rx=0 tx=0).stop 2023-03-03T07:43:50.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.904+0000 7f85957f9700 1 -- 172.21.15.57:0/1495549704 shutdown_connections 2023-03-03T07:43:50.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.904+0000 7f85957f9700 1 --2- 172.21.15.57:0/1495549704 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85900992b0 0x7f8590099680 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:50.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.904+0000 7f85957f9700 1 -- 172.21.15.57:0/1495549704 >> 172.21.15.57:0/1495549704 conn(0x7f859006cc70 msgr2=0x7f859006f080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:50.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.908+0000 7f85957f9700 1 -- 172.21.15.57:0/1495549704 shutdown_connections 2023-03-03T07:43:50.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.908+0000 7f85957f9700 1 -- 172.21.15.57:0/1495549704 wait complete. 2023-03-03T07:43:50.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.908+0000 7f85957f9700 1 Processor -- start 2023-03-03T07:43:50.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.908+0000 7f85957f9700 1 -- start start 2023-03-03T07:43:50.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.908+0000 7f85957f9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f859008e390 0x7f85901bbed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:50.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.908+0000 7f85957f9700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f859008ff30 con 0x7f859008e390 2023-03-03T07:43:50.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.912+0000 7f858ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f859008e390 0x7f85901bbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:50.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.912+0000 7f858ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f859008e390 0x7f85901bbed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52112/0 (socket says 172.21.15.57:52112) 2023-03-03T07:43:50.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.912+0000 7f858ffff700 1 -- 172.21.15.57:0/2622418660 learned_addr learned my addr 172.21.15.57:0/2622418660 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:50.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.912+0000 7f858ffff700 1 -- 172.21.15.57:0/2622418660 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8580009570 con 0x7f859008e390 2023-03-03T07:43:50.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.912+0000 7f858ffff700 1 --2- 172.21.15.57:0/2622418660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f859008e390 0x7f85901bbed0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8580009be0 tx=0x7f8580004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:50.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.912+0000 7f858d7fa700 1 -- 172.21.15.57:0/2622418660 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f858000b670 con 0x7f859008e390 2023-03-03T07:43:50.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.912+0000 7f858d7fa700 1 -- 172.21.15.57:0/2622418660 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f858000b7d0 con 0x7f859008e390 2023-03-03T07:43:50.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.912+0000 7f858d7fa700 1 -- 172.21.15.57:0/2622418660 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f858000ba70 con 0x7f859008e390 2023-03-03T07:43:50.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.912+0000 7f85957f9700 1 -- 172.21.15.57:0/2622418660 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8590099d50 con 0x7f859008e390 2023-03-03T07:43:50.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.912+0000 7f85957f9700 1 -- 172.21.15.57:0/2622418660 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8590099bc0 con 0x7f859008e390 2023-03-03T07:43:50.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.916+0000 7f858d7fa700 1 -- 172.21.15.57:0/2622418660 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42205+0+0 (secure 0 0 0) 0x7f8580017020 con 0x7f859008e390 2023-03-03T07:43:50.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.916+0000 7f858d7fa700 1 --2- 172.21.15.57:0/2622418660 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f8570034830 0x7f8570036ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:50.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.916+0000 7f858d7fa700 1 -- 172.21.15.57:0/2622418660 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2928+0+0 (secure 0 0 0) 0x7f8580047da0 con 0x7f859008e390 2023-03-03T07:43:50.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.916+0000 7f8587fff700 1 --2- 172.21.15.57:0/2622418660 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f8570034830 0x7f8570036ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:50.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.920+0000 7f8587fff700 1 --2- 172.21.15.57:0/2622418660 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f8570034830 0x7f8570036ce0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8578001620 tx=0x7f8578007b00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:50.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.920+0000 7f8599ce4740 1 Processor -- start 2023-03-03T07:43:50.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.920+0000 7f8599ce4740 1 -- start start 2023-03-03T07:43:50.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.920+0000 7f8599ce4740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xd6aae0 0xfeb780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:50.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.920+0000 7f8599ce4740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0xed9f00 con 0xd6aae0 2023-03-03T07:43:50.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.920+0000 7f858ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xd6aae0 0xfeb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:50.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.920+0000 7f858ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xd6aae0 0xfeb780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52120/0 (socket says 172.21.15.57:52120) 2023-03-03T07:43:50.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.920+0000 7f858ffff700 1 -- 172.21.15.57:0/944859444 learned_addr learned my addr 172.21.15.57:0/944859444 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:50.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.920+0000 7f858ffff700 1 -- 172.21.15.57:0/944859444 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xf68c90 con 0xd6aae0 2023-03-03T07:43:50.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.924+0000 7f858ffff700 1 --2- 172.21.15.57:0/944859444 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xd6aae0 0xfeb780 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8580019e30 tx=0x7f8580019e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e37ed3fa2925efc1 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:50.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.924+0000 7f8585ffb700 1 -- 172.21.15.57:0/944859444 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f858001a460 con 0xd6aae0 2023-03-03T07:43:50.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.924+0000 7f8585ffb700 1 -- 172.21.15.57:0/944859444 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8580031070 con 0xd6aae0 2023-03-03T07:43:50.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.924+0000 7f8585ffb700 1 -- 172.21.15.57:0/944859444 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f858000bbd0 con 0xd6aae0 2023-03-03T07:43:50.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.924+0000 7f8599ce4740 1 -- 172.21.15.57:0/944859444 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xd6aae0 msgr2=0xfeb780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:50.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.924+0000 7f8599ce4740 1 --2- 172.21.15.57:0/944859444 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xd6aae0 0xfeb780 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8580019e30 tx=0x7f8580019e60 comp rx=0 tx=0).stop 2023-03-03T07:43:50.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.924+0000 7f8599ce4740 1 -- 172.21.15.57:0/944859444 shutdown_connections 2023-03-03T07:43:50.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.924+0000 7f8599ce4740 1 --2- 172.21.15.57:0/944859444 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xd6aae0 0xfeb780 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:50.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.924+0000 7f8599ce4740 1 -- 172.21.15.57:0/944859444 >> 172.21.15.57:0/944859444 conn(0xd6aeb0 msgr2=0xfdc7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:50.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.924+0000 7f8599ce4740 1 -- 172.21.15.57:0/944859444 shutdown_connections 2023-03-03T07:43:50.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.924+0000 7f8599ce4740 1 -- 172.21.15.57:0/944859444 wait complete. 2023-03-03T07:43:50.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.924+0000 7f8599ce4740 1 -- start start 2023-03-03T07:43:50.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.924+0000 7f8599ce4740 1 Processor -- start 2023-03-03T07:43:50.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.924+0000 7f8599ce4740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xd6aae0 0xff2df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:50.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.924+0000 7f8599ce4740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0xf49ff0 con 0xd6aae0 2023-03-03T07:43:50.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.924+0000 7f8599ce4740 10 client.0 _ll_register_callbacks cb 0xf9ed00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-03T07:43:50.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.928+0000 7f858ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xd6aae0 0xff2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:50.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.928+0000 7f858ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xd6aae0 0xff2df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52132/0 (socket says 172.21.15.57:52132) 2023-03-03T07:43:50.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.928+0000 7f858ffff700 1 -- 172.21.15.57:0/3939802166 learned_addr learned my addr 172.21.15.57:0/3939802166 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:50.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.928+0000 7f858ffff700 1 -- 172.21.15.57:0/3939802166 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8590099bc0 con 0xd6aae0 2023-03-03T07:43:50.934 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.928+0000 7f858ffff700 1 --2- 172.21.15.57:0/3939802166 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xd6aae0 0xff2df0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8580013040 tx=0x7f858002df10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47b8793ba15dcddd server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:50.934 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.928+0000 7f856effd700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-03T07:43:50.934 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.928+0000 7f856effd700 1 -- 172.21.15.57:0/3939802166 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f858000bde0 con 0xd6aae0 2023-03-03T07:43:50.934 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.928+0000 7f856effd700 1 -- 172.21.15.57:0/3939802166 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(16..16 src has 1..16) v4 ==== 2928+0+0 (secure 0 0 0) 0x7f8580041020 con 0xd6aae0 2023-03-03T07:43:50.935 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.928+0000 7f8599ce4740 1 -- 172.21.15.57:0/3939802166 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xf3c370 con 0xd6aae0 2023-03-03T07:43:50.935 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.928+0000 7f856effd700 1 -- 172.21.15.57:0/3939802166 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f85800411e0 con 0xd6aae0 2023-03-03T07:43:50.935 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.928+0000 7f8599ce4740 10 client.4243 fetch_fsmap learned FSMap version 6 2023-03-03T07:43:50.935 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.928+0000 7f8599ce4740 1 -- 172.21.15.57:0/3939802166 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0xdb69e0 con 0xd6aae0 2023-03-03T07:43:50.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.928+0000 7f856effd700 1 -- 172.21.15.57:0/3939802166 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xf3c370 con 0xd6aae0 2023-03-03T07:43:50.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.928+0000 7f856effd700 1 -- 172.21.15.57:0/3939802166 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 6) v1 ==== 1471+0+0 (secure 0 0 0) 0x7f858004e050 con 0xd6aae0 2023-03-03T07:43:50.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.928+0000 7f8599ce4740 10 client.4243 fetch_fsmap finished waiting for FSMap version 6 2023-03-03T07:43:50.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.928+0000 7f8599ce4740 10 client.4243 resolve_mds: resolved name 'a' to daemon mds.a 2023-03-03T07:43:50.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.928+0000 7f8599ce4740 20 client.4243 populate_metadata read hostname 'smithi057' 2023-03-03T07:43:50.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.928+0000 7f8599ce4740 1 --2- 172.21.15.57:0/3939802166 >> [v2:172.21.15.57:6810/2058274046,v1:172.21.15.57:6811/2058274046] conn(0xd6a710 0xfdee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:50.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.928+0000 7f8599ce4740 4 client.4243 mds_command: new command op to 4134 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-03T07:43:50.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.928+0000 7f8599ce4740 1 -- 172.21.15.57:0/3939802166 --> [v2:172.21.15.57:6810/2058274046,v1:172.21.15.57:6811/2058274046] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xf3c090 con 0xd6a710 2023-03-03T07:43:50.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.932+0000 7f8587fff700 1 --2- 172.21.15.57:0/3939802166 >> [v2:172.21.15.57:6810/2058274046,v1:172.21.15.57:6811/2058274046] conn(0xd6a710 0xfdee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:50.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.932+0000 7f8587fff700 1 --2- 172.21.15.57:0/3939802166 >> [v2:172.21.15.57:6810/2058274046,v1:172.21.15.57:6811/2058274046] conn(0xd6a710 0xfdee00 crc :-1 s=READY pgs=4 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a58b5f42ac0b47b8 server_cookie=2ec194d0131c2762 in_seq=0 out_seq=0 2023-03-03T07:43:50.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.932+0000 7f856effd700 10 client.4243 ms_handle_connect on v2:172.21.15.57:6810/2058274046 2023-03-03T07:43:50.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.932+0000 7f856effd700 1 -- 172.21.15.57:0/3939802166 <== mds.0 v2:172.21.15.57:6810/2058274046 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0xf3c090 con 0xd6a710 2023-03-03T07:43:50.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.932+0000 7f856effd700 10 client.4243 handle_command_reply: tid=0 2023-03-03T07:43:50.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.932+0000 7f8599ce4740 1 client.4243 shutdown 2023-03-03T07:43:50.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.932+0000 7f8599ce4740 1 -- 172.21.15.57:0/3939802166 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xd6aae0 msgr2=0xff2df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:50.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.932+0000 7f8599ce4740 1 --2- 172.21.15.57:0/3939802166 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xd6aae0 0xff2df0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8580013040 tx=0x7f858002df10 comp rx=0 tx=0).stop 2023-03-03T07:43:50.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.932+0000 7f8599ce4740 1 -- 172.21.15.57:0/3939802166 shutdown_connections 2023-03-03T07:43:50.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.932+0000 7f8599ce4740 1 --2- 172.21.15.57:0/3939802166 >> [v2:172.21.15.57:6810/2058274046,v1:172.21.15.57:6811/2058274046] conn(0xd6a710 0xfdee00 crc :-1 s=READY pgs=4 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:50.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.932+0000 7f8599ce4740 1 --2- 172.21.15.57:0/3939802166 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xd6aae0 0xff2df0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:50.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.932+0000 7f8599ce4740 1 -- 172.21.15.57:0/3939802166 >> 172.21.15.57:0/3939802166 conn(0xd6aeb0 msgr2=0xfd8350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:50.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.932+0000 7f856effd700 0 client.4243 ms_handle_reset on v2:172.21.15.57:6810/2058274046 2023-03-03T07:43:50.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.936+0000 7f8599ce4740 1 -- 172.21.15.57:0/3939802166 shutdown_connections 2023-03-03T07:43:50.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.936+0000 7f8599ce4740 1 -- 172.21.15.57:0/3939802166 wait complete. 2023-03-03T07:43:50.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.936+0000 7f8599ce4740 20 client.4243 trim_cache size 0 max 16384 2023-03-03T07:43:50.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.956+0000 7f8599ce4740 1 Processor -- start 2023-03-03T07:43:50.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.956+0000 7f8599ce4740 1 -- start start 2023-03-03T07:43:50.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.956+0000 7f8599ce4740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xdb5790 0xffdf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:50.962 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.956+0000 7f8599ce4740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0xf432f0 con 0xdb5790 2023-03-03T07:43:50.962 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.956+0000 7f858ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xdb5790 0xffdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:50.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.956+0000 7f858ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xdb5790 0xffdf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52142/0 (socket says 172.21.15.57:52142) 2023-03-03T07:43:50.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.956+0000 7f858ffff700 1 -- 172.21.15.57:0/2056979924 learned_addr learned my addr 172.21.15.57:0/2056979924 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:50.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.956+0000 7f858ffff700 1 -- 172.21.15.57:0/2056979924 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85901bc770 con 0xdb5790 2023-03-03T07:43:50.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.960+0000 7f858ffff700 1 --2- 172.21.15.57:0/2056979924 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xdb5790 0xffdf80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f858002c560 tx=0x7f8580038070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2ff3b955948851b server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:50.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.960+0000 7f85867fc700 1 -- 172.21.15.57:0/2056979924 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f858002d610 con 0xdb5790 2023-03-03T07:43:50.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.960+0000 7f85867fc700 1 -- 172.21.15.57:0/2056979924 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f858003c040 con 0xdb5790 2023-03-03T07:43:50.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.960+0000 7f85867fc700 1 -- 172.21.15.57:0/2056979924 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f858001a5c0 con 0xdb5790 2023-03-03T07:43:50.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.960+0000 7f8599ce4740 1 -- 172.21.15.57:0/2056979924 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xdb5790 msgr2=0xffdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:50.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.960+0000 7f8599ce4740 1 --2- 172.21.15.57:0/2056979924 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xdb5790 0xffdf80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f858002c560 tx=0x7f8580038070 comp rx=0 tx=0).stop 2023-03-03T07:43:50.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.960+0000 7f8599ce4740 1 -- 172.21.15.57:0/2056979924 shutdown_connections 2023-03-03T07:43:50.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.960+0000 7f8599ce4740 1 --2- 172.21.15.57:0/2056979924 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xdb5790 0xffdf80 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:50.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.960+0000 7f8599ce4740 1 -- 172.21.15.57:0/2056979924 >> 172.21.15.57:0/2056979924 conn(0xd6aeb0 msgr2=0xfddd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:50.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.960+0000 7f8599ce4740 1 -- 172.21.15.57:0/2056979924 shutdown_connections 2023-03-03T07:43:50.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.960+0000 7f8599ce4740 1 -- 172.21.15.57:0/2056979924 wait complete. 2023-03-03T07:43:50.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.960+0000 7f8599ce4740 1 -- start start 2023-03-03T07:43:50.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.960+0000 7f8599ce4740 1 Processor -- start 2023-03-03T07:43:50.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.964+0000 7f8599ce4740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xffdf70 0x1040840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:50.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.964+0000 7f8599ce4740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0xdefb20 con 0xffdf70 2023-03-03T07:43:50.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.964+0000 7f8599ce4740 10 client.0 _ll_register_callbacks cb 0x7f858002c3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-03T07:43:50.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.964+0000 7f858ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xffdf70 0x1040840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:50.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.964+0000 7f858ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xffdf70 0x1040840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52144/0 (socket says 172.21.15.57:52144) 2023-03-03T07:43:50.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.964+0000 7f858ffff700 1 -- 172.21.15.57:0/2004671067 learned_addr learned my addr 172.21.15.57:0/2004671067 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:50.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.964+0000 7f858ffff700 1 -- 172.21.15.57:0/2004671067 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0xdb69e0 con 0xffdf70 2023-03-03T07:43:50.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.964+0000 7f858ffff700 1 --2- 172.21.15.57:0/2004671067 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xffdf70 0x1040840 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8580011f90 tx=0x7f858002c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daf2e2699414e012 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:50.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.964+0000 7f856effd700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-03-03T07:43:50.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.964+0000 7f856effd700 1 -- 172.21.15.57:0/2004671067 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f858001a5c0 con 0xffdf70 2023-03-03T07:43:50.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.964+0000 7f856effd700 1 -- 172.21.15.57:0/2004671067 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(16..16 src has 1..16) v4 ==== 2928+0+0 (secure 0 0 0) 0x7f858002d800 con 0xffdf70 2023-03-03T07:43:50.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.964+0000 7f8599ce4740 1 -- 172.21.15.57:0/2004671067 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8580031070 con 0xffdf70 2023-03-03T07:43:50.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.964+0000 7f856effd700 1 -- 172.21.15.57:0/2004671067 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f858002da00 con 0xffdf70 2023-03-03T07:43:50.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.964+0000 7f8599ce4740 10 client.4245 fetch_fsmap learned FSMap version 6 2023-03-03T07:43:50.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.964+0000 7f8599ce4740 1 -- 172.21.15.57:0/2004671067 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0xeefe40 con 0xffdf70 2023-03-03T07:43:50.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.968+0000 7f856effd700 1 -- 172.21.15.57:0/2004671067 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8580031070 con 0xffdf70 2023-03-03T07:43:50.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.968+0000 7f856effd700 1 -- 172.21.15.57:0/2004671067 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 6) v1 ==== 1471+0+0 (secure 0 0 0) 0x7f858004e070 con 0xffdf70 2023-03-03T07:43:50.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.968+0000 7f8599ce4740 10 client.4245 fetch_fsmap finished waiting for FSMap version 6 2023-03-03T07:43:50.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.968+0000 7f8599ce4740 10 client.4245 resolve_mds: resolved name 'a' to daemon mds.a 2023-03-03T07:43:50.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.968+0000 7f8599ce4740 20 client.4245 populate_metadata read hostname 'smithi057' 2023-03-03T07:43:50.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.968+0000 7f8599ce4740 1 --2- 172.21.15.57:0/2004671067 >> [v2:172.21.15.57:6810/2058274046,v1:172.21.15.57:6811/2058274046] conn(0x1040d80 0x1041180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:50.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.968+0000 7f8599ce4740 4 client.4245 mds_command: new command op to 4134 tid=0[{"prefix": "status"}] 2023-03-03T07:43:50.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.968+0000 7f8599ce4740 1 -- 172.21.15.57:0/2004671067 --> [v2:172.21.15.57:6810/2058274046,v1:172.21.15.57:6811/2058274046] -- command(tid 0: {"prefix": "status"}) v1 -- 0xde7260 con 0x1040d80 2023-03-03T07:43:50.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.968+0000 7f8587fff700 1 --2- 172.21.15.57:0/2004671067 >> [v2:172.21.15.57:6810/2058274046,v1:172.21.15.57:6811/2058274046] conn(0x1040d80 0x1041180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:50.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.968+0000 7f8587fff700 1 --2- 172.21.15.57:0/2004671067 >> [v2:172.21.15.57:6810/2058274046,v1:172.21.15.57:6811/2058274046] conn(0x1040d80 0x1041180 crc :-1 s=READY pgs=5 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7fa2b502a7aaa709 server_cookie=96ced8a770aabd27 in_seq=0 out_seq=0 2023-03-03T07:43:50.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.968+0000 7f856effd700 10 client.4245 ms_handle_connect on v2:172.21.15.57:6810/2058274046 2023-03-03T07:43:50.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.968+0000 7f856effd700 1 -- 172.21.15.57:0/2004671067 <== mds.0 v2:172.21.15.57:6810/2058274046 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0xde7260 con 0x1040d80 2023-03-03T07:43:50.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.968+0000 7f856effd700 10 client.4245 handle_command_reply: tid=0 2023-03-03T07:43:50.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.968+0000 7f8599ce4740 1 client.4245 shutdown 2023-03-03T07:43:50.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.968+0000 7f8599ce4740 1 -- 172.21.15.57:0/2004671067 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xffdf70 msgr2=0x1040840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:50.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.968+0000 7f8599ce4740 1 --2- 172.21.15.57:0/2004671067 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xffdf70 0x1040840 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8580011f90 tx=0x7f858002c450 comp rx=0 tx=0).stop 2023-03-03T07:43:50.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.968+0000 7f8599ce4740 1 -- 172.21.15.57:0/2004671067 shutdown_connections 2023-03-03T07:43:50.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.968+0000 7f8599ce4740 1 --2- 172.21.15.57:0/2004671067 >> [v2:172.21.15.57:6810/2058274046,v1:172.21.15.57:6811/2058274046] conn(0x1040d80 0x1041180 crc :-1 s=READY pgs=5 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:50.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.968+0000 7f8599ce4740 1 --2- 172.21.15.57:0/2004671067 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xffdf70 0x1040840 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:50.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.968+0000 7f8599ce4740 1 -- 172.21.15.57:0/2004671067 >> 172.21.15.57:0/2004671067 conn(0xd6aeb0 msgr2=0xff9f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:50.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.968+0000 7f856effd700 0 client.4245 ms_handle_reset on v2:172.21.15.57:6810/2058274046 2023-03-03T07:43:50.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.972+0000 7f8599ce4740 1 -- 172.21.15.57:0/2004671067 shutdown_connections 2023-03-03T07:43:50.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.972+0000 7f8599ce4740 1 -- 172.21.15.57:0/2004671067 wait complete. 2023-03-03T07:43:50.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.972+0000 7f8599ce4740 20 client.4245 trim_cache size 0 max 16384 2023-03-03T07:43:50.979 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-03-03T07:43:50.979 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_fsid": "5022d617-ad40-4ad9-8d5b-120958296d9c", 2023-03-03T07:43:50.979 INFO:teuthology.orchestra.run.smithi057.stdout: "whoami": 0, 2023-03-03T07:43:50.979 INFO:teuthology.orchestra.run.smithi057.stdout: "id": 4134, 2023-03-03T07:43:50.979 INFO:teuthology.orchestra.run.smithi057.stdout: "want_state": "up:active", 2023-03-03T07:43:50.980 INFO:teuthology.orchestra.run.smithi057.stdout: "state": "up:active", 2023-03-03T07:43:50.980 INFO:teuthology.orchestra.run.smithi057.stdout: "fs_name": "cephfs", 2023-03-03T07:43:50.980 INFO:teuthology.orchestra.run.smithi057.stdout: "rank_uptime": 14.615165751999999, 2023-03-03T07:43:50.980 INFO:teuthology.orchestra.run.smithi057.stdout: "mdsmap_epoch": 6, 2023-03-03T07:43:50.980 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch": 16, 2023-03-03T07:43:50.980 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch_barrier": 16, 2023-03-03T07:43:50.980 INFO:teuthology.orchestra.run.smithi057.stdout: "uptime": 20.964451557 2023-03-03T07:43:50.981 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-03-03T07:43:50.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.972+0000 7f85957f9700 1 -- 172.21.15.57:0/2622418660 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f8570034830 msgr2=0x7f8570036ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:50.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.972+0000 7f85957f9700 1 --2- 172.21.15.57:0/2622418660 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f8570034830 0x7f8570036ce0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8578001620 tx=0x7f8578007b00 comp rx=0 tx=0).stop 2023-03-03T07:43:50.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.972+0000 7f85957f9700 1 -- 172.21.15.57:0/2622418660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f859008e390 msgr2=0x7f85901bbed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:50.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.972+0000 7f85957f9700 1 --2- 172.21.15.57:0/2622418660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f859008e390 0x7f85901bbed0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8580009be0 tx=0x7f8580004770 comp rx=0 tx=0).stop 2023-03-03T07:43:50.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.972+0000 7f85957f9700 1 -- 172.21.15.57:0/2622418660 shutdown_connections 2023-03-03T07:43:50.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.972+0000 7f85957f9700 1 --2- 172.21.15.57:0/2622418660 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f8570034830 0x7f8570036ce0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:50.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.972+0000 7f85957f9700 1 --2- 172.21.15.57:0/2622418660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f859008e390 0x7f85901bbed0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:50.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.972+0000 7f85957f9700 1 -- 172.21.15.57:0/2622418660 >> 172.21.15.57:0/2622418660 conn(0x7f859006cc70 msgr2=0x7f85901ae830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:50.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.972+0000 7f85957f9700 1 -- 172.21.15.57:0/2622418660 shutdown_connections 2023-03-03T07:43:50.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:50.972+0000 7f85957f9700 1 -- 172.21.15.57:0/2622418660 wait complete. 2023-03-03T07:43:51.010 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-03-03T07:43:51.035 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-03-03T07:43:51.036 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2023-03-03T07:43:51.036 INFO:tasks.ceph_fuse:client.0 config is {} 2023-03-03T07:43:51.036 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-03-03T07:43:51.037 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-03-03T07:43:51.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T07:43:51.037 DEBUG:teuthology.orchestra.run.smithi057:> ip netns list 2023-03-03T07:43:51.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T07:43:51.062 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link delete ceph-brx 2023-03-03T07:43:51.160 INFO:teuthology.orchestra.run.smithi057.stderr:Cannot find device "ceph-brx" 2023-03-03T07:43:51.164 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-03T07:43:51.165 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-03-03T07:43:51.165 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-03-03T07:43:51.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:51.368+0000 7f6fb74dc700 1 Processor -- start 2023-03-03T07:43:51.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:51.372+0000 7f6fb74dc700 1 -- start start 2023-03-03T07:43:51.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:51.372+0000 7f6fb74dc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6fb006a790 0x7f6fb008aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:51.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:51.372+0000 7f6fb74dc700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fb0095ee0 con 0x7f6fb008a6c0 2023-03-03T07:43:51.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:51.372+0000 7f6fb74dc700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fb0071300 con 0x7f6fb006a790 2023-03-03T07:43:51.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:51.372+0000 7f6fb64da700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f6fb008a6c0 0x7f6fb0123890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:38308/0 (socket says 172.21.15.57:38308) 2023-03-03T07:43:51.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:51.372+0000 7f6fb64da700 1 -- 172.21.15.57:0/4209961944 learned_addr learned my addr 172.21.15.57:0/4209961944 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:43:51.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:51.372+0000 7f6fb5cd9700 1 --2- 172.21.15.57:0/4209961944 >> v2:172.21.15.57:3300/0 conn(0x7f6fb006a790 0x7f6fb008aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:51.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:51.372+0000 7f6fb54d8700 1 -- 172.21.15.57:0/4209961944 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2412293706 0 0) 0x7f6fb0095ee0 con 0x7f6fb008a6c0 2023-03-03T07:43:51.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:51.372+0000 7f6fb54d8700 1 -- 172.21.15.57:0/4209961944 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f9c0057e0 con 0x7f6fb008a6c0 2023-03-03T07:43:51.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:51.372+0000 7f6fb5cd9700 1 -- 172.21.15.57:0/4209961944 >> v1:172.21.15.57:6789/0 conn(0x7f6fb008a6c0 legacy=0x7f6fb0123890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:51.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:51.372+0000 7f6fb5cd9700 1 -- 172.21.15.57:0/4209961944 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb0071440 con 0x7f6fb006a790 2023-03-03T07:43:51.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:51.376+0000 7f6fb5cd9700 1 --2- 172.21.15.57:0/4209961944 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6fb006a790 0x7f6fb008aa90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6fa00097d0 tx=0x7f6fa0009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=546bd14393416534 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:51.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:51.376+0000 7f6fb54d8700 1 -- 172.21.15.57:0/4209961944 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6fa0004160 con 0x7f6fb006a790 2023-03-03T07:43:51.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:51.376+0000 7f6fb54d8700 1 -- 172.21.15.57:0/4209961944 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa00042c0 con 0x7f6fb006a790 2023-03-03T07:43:51.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:51.376+0000 7f6fb54d8700 1 -- 172.21.15.57:0/4209961944 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6fa00045a0 con 0x7f6fb006a790 2023-03-03T07:43:51.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:51.376+0000 7f6fb74dc700 1 -- 172.21.15.57:0/4209961944 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6fb006a790 msgr2=0x7f6fb008aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:51.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:51.376+0000 7f6fb74dc700 1 --2- 172.21.15.57:0/4209961944 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6fb006a790 0x7f6fb008aa90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6fa00097d0 tx=0x7f6fa0009ae0 comp rx=0 tx=0).stop 2023-03-03T07:43:51.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:51.376+0000 7f6fb74dc700 1 -- 172.21.15.57:0/4209961944 shutdown_connections 2023-03-03T07:43:51.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:51.376+0000 7f6fb74dc700 1 --2- 172.21.15.57:0/4209961944 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6fb006a790 0x7f6fb008aa90 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:51.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:51.376+0000 7f6fb74dc700 1 -- 172.21.15.57:0/4209961944 >> 172.21.15.57:0/4209961944 conn(0x7f6fb006c840 msgr2=0x7f6fb006ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:51.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:51.376+0000 7f6fb74dc700 1 -- 172.21.15.57:0/4209961944 shutdown_connections 2023-03-03T07:43:51.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:51.376+0000 7f6fb74dc700 1 -- 172.21.15.57:0/4209961944 wait complete. 2023-03-03T07:43:51.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:51.380+0000 7f6fb74dc700 1 Processor -- start 2023-03-03T07:43:51.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:51.380+0000 7f6fb74dc700 1 -- start start 2023-03-03T07:43:51.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:51.380+0000 7f6fb74dc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6fb006a790 0x7f6fb01b9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:51.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:51.380+0000 7f6fb74dc700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb0094010 con 0x7f6fb006a790 2023-03-03T07:43:51.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:51.384+0000 7f6fb64da700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6fb006a790 0x7f6fb01b9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:51.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:51.384+0000 7f6fb64da700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6fb006a790 0x7f6fb01b9bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52164/0 (socket says 172.21.15.57:52164) 2023-03-03T07:43:51.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:51.384+0000 7f6fb64da700 1 -- 172.21.15.57:0/1842825451 learned_addr learned my addr 172.21.15.57:0/1842825451 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:43:51.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:51.384+0000 7f6fb64da700 1 -- 172.21.15.57:0/1842825451 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa00094b0 con 0x7f6fb006a790 2023-03-03T07:43:51.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:51.384+0000 7f6fb64da700 1 --2- 172.21.15.57:0/1842825451 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6fb006a790 0x7f6fb01b9bb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6fac00cb40 tx=0x7f6fac00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:51.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:51.384+0000 7f6fa6ffd700 1 -- 172.21.15.57:0/1842825451 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6fac00a760 con 0x7f6fb006a790 2023-03-03T07:43:51.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:51.384+0000 7f6fa6ffd700 1 -- 172.21.15.57:0/1842825451 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fac00a8c0 con 0x7f6fb006a790 2023-03-03T07:43:51.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:51.384+0000 7f6fb74dc700 1 -- 172.21.15.57:0/1842825451 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fb008a150 con 0x7f6fb006a790 2023-03-03T07:43:51.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:51.384+0000 7f6fa6ffd700 1 -- 172.21.15.57:0/1842825451 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6fac00ab60 con 0x7f6fb006a790 2023-03-03T07:43:51.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:51.384+0000 7f6fb74dc700 1 -- 172.21.15.57:0/1842825451 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fb0089fc0 con 0x7f6fb006a790 2023-03-03T07:43:51.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:51.388+0000 7f6fb74dc700 1 -- 172.21.15.57:0/1842825451 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fb0123fa0 con 0x7f6fb006a790 2023-03-03T07:43:51.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:51.388+0000 7f6fa6ffd700 1 -- 172.21.15.57:0/1842825451 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42205+0+0 (secure 0 0 0) 0x7f6fac019030 con 0x7f6fb006a790 2023-03-03T07:43:51.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:51.388+0000 7f6fa6ffd700 1 --2- 172.21.15.57:0/1842825451 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f6f94034840 0x7f6f94036cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:43:51.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:51.388+0000 7f6fa6ffd700 1 -- 172.21.15.57:0/1842825451 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2928+0+0 (secure 0 0 0) 0x7f6fac045a10 con 0x7f6fb006a790 2023-03-03T07:43:51.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:51.388+0000 7f6fb5cd9700 1 --2- 172.21.15.57:0/1842825451 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f6f94034840 0x7f6f94036cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:43:51.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:51.392+0000 7f6fb5cd9700 1 --2- 172.21.15.57:0/1842825451 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f6f94034840 0x7f6f94036cf0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6fa00097d0 tx=0x7f6fa0008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:43:51.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:51.396+0000 7f6fa6ffd700 1 -- 172.21.15.57:0/1842825451 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6fac01b3b0 con 0x7f6fb006a790 2023-03-03T07:43:51.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:51.624+0000 7f6fb74dc700 1 -- 172.21.15.57:0/1842825451 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6fb00619b0 con 0x7f6fb006a790 2023-03-03T07:43:51.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:51.624+0000 7f6fa6ffd700 1 -- 172.21.15.57:0/1842825451 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6fac017030 con 0x7f6fb006a790 2023-03-03T07:43:51.630 INFO:teuthology.orchestra.run.smithi057.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-03-03T07:43:51.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:51.628+0000 7f6fb74dc700 1 -- 172.21.15.57:0/1842825451 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f6f94034840 msgr2=0x7f6f94036cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:51.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:51.628+0000 7f6fb74dc700 1 --2- 172.21.15.57:0/1842825451 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f6f94034840 0x7f6f94036cf0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6fa00097d0 tx=0x7f6fa0008030 comp rx=0 tx=0).stop 2023-03-03T07:43:51.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:51.628+0000 7f6fb74dc700 1 -- 172.21.15.57:0/1842825451 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6fb006a790 msgr2=0x7f6fb01b9bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:43:51.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:51.628+0000 7f6fb74dc700 1 --2- 172.21.15.57:0/1842825451 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6fb006a790 0x7f6fb01b9bb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6fac00cb40 tx=0x7f6fac00cc20 comp rx=0 tx=0).stop 2023-03-03T07:43:51.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:51.628+0000 7f6fb74dc700 1 -- 172.21.15.57:0/1842825451 shutdown_connections 2023-03-03T07:43:51.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:51.628+0000 7f6fb74dc700 1 --2- 172.21.15.57:0/1842825451 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f6f94034840 0x7f6f94036cf0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:51.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:51.628+0000 7f6fb74dc700 1 --2- 172.21.15.57:0/1842825451 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6fb006a790 0x7f6fb01b9bb0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:43:51.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:51.628+0000 7f6fb74dc700 1 -- 172.21.15.57:0/1842825451 >> 172.21.15.57:0/1842825451 conn(0x7f6fb006c840 msgr2=0x7f6fb011b100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:43:51.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:51.628+0000 7f6fb74dc700 1 -- 172.21.15.57:0/1842825451 shutdown_connections 2023-03-03T07:43:51.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T07:43:51.628+0000 7f6fb74dc700 1 -- 172.21.15.57:0/1842825451 wait complete. 2023-03-03T07:43:51.662 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-03-03T07:43:51.663 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-03-03T07:43:51.663 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi057.front.sepia.ceph.com 2023-03-03T07:43:51.663 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-03-03T07:43:51.663 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-03-03T07:43:51.664 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-03-03T07:43:51.664 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-03-03T07:43:51.664 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-03-03T07:43:51.664 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-03-03T07:43:51.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T07:43:51.665 DEBUG:teuthology.orchestra.run.smithi057:> ip addr 2023-03-03T07:43:51.687 INFO:teuthology.orchestra.run.smithi057.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-03-03T07:43:51.688 INFO:teuthology.orchestra.run.smithi057.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-03-03T07:43:51.688 INFO:teuthology.orchestra.run.smithi057.stdout: inet 127.0.0.1/8 scope host lo 2023-03-03T07:43:51.688 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-03-03T07:43:51.688 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 ::1/128 scope host 2023-03-03T07:43:51.688 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-03-03T07:43:51.688 INFO:teuthology.orchestra.run.smithi057.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-03-03T07:43:51.688 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:6b:ff:86 brd ff:ff:ff:ff:ff:ff 2023-03-03T07:43:51.689 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp7s0f0 2023-03-03T07:43:51.689 INFO:teuthology.orchestra.run.smithi057.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-03-03T07:43:51.689 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:6b:ff:87 brd ff:ff:ff:ff:ff:ff 2023-03-03T07:43:51.689 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp7s0f1 2023-03-03T07:43:51.689 INFO:teuthology.orchestra.run.smithi057.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-03-03T07:43:51.689 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:bd:15:62 brd ff:ff:ff:ff:ff:ff 2023-03-03T07:43:51.689 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp1s0f0 2023-03-03T07:43:51.690 INFO:teuthology.orchestra.run.smithi057.stdout: inet 172.21.15.57/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-03-03T07:43:51.690 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft 42382sec preferred_lft 42382sec 2023-03-03T07:43:51.690 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 fe80::ec4:7aff:febd:1562/64 scope link 2023-03-03T07:43:51.690 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-03-03T07:43:51.690 INFO:teuthology.orchestra.run.smithi057.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-03-03T07:43:51.690 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:bd:15:63 brd ff:ff:ff:ff:ff:ff 2023-03-03T07:43:51.690 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp1s0f1 2023-03-03T07:43:51.690 INFO:teuthology.orchestra.run.smithi057.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-03-03T07:43:51.691 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 02:42:05:1e:9f:ab brd ff:ff:ff:ff:ff:ff 2023-03-03T07:43:51.691 INFO:teuthology.orchestra.run.smithi057.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-03-03T07:43:51.691 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-03-03T07:43:51.692 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-03-03T07:43:51.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T07:43:51.693 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec bash -c ' 2023-03-03T07:43:51.693 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2023-03-03T07:43:51.693 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link add name ceph-brx type bridge 2023-03-03T07:43:51.693 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip addr flush dev ceph-brx 2023-03-03T07:43:51.694 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link set ceph-brx up 2023-03-03T07:43:51.694 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-03-03T07:43:51.694 DEBUG:teuthology.orchestra.run.smithi057:> ') 2023-03-03T07:43:51.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T07:43:51.892 DEBUG:teuthology.orchestra.run.smithi057:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-03-03T07:43:51.939 INFO:teuthology.orchestra.run.smithi057.stdout:1 2023-03-03T07:43:51.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T07:43:51.945 DEBUG:teuthology.orchestra.run.smithi057:> route 2023-03-03T07:43:52.035 INFO:teuthology.orchestra.run.smithi057.stdout:Kernel IP routing table 2023-03-03T07:43:52.035 INFO:teuthology.orchestra.run.smithi057.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-03-03T07:43:52.035 INFO:teuthology.orchestra.run.smithi057.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-03-03T07:43:52.035 INFO:teuthology.orchestra.run.smithi057.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-03-03T07:43:52.035 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-03-03T07:43:52.035 INFO:teuthology.orchestra.run.smithi057.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-03-03T07:43:52.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T07:43:52.037 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec bash -c ' 2023-03-03T07:43:52.037 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2023-03-03T07:43:52.037 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-03-03T07:43:52.038 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-03-03T07:43:52.038 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-03-03T07:43:52.038 DEBUG:teuthology.orchestra.run.smithi057:> ') 2023-03-03T07:43:52.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T07:43:52.209 DEBUG:teuthology.orchestra.run.smithi057:> ip netns list 2023-03-03T07:43:52.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T07:43:52.231 DEBUG:teuthology.orchestra.run.smithi057:> ip netns list-id 2023-03-03T07:43:52.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T07:43:52.294 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec bash -c ' 2023-03-03T07:43:52.294 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2023-03-03T07:43:52.294 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-03-03T07:43:52.295 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-03-03T07:43:52.295 DEBUG:teuthology.orchestra.run.smithi057:> ') 2023-03-03T07:43:52.437 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-03-03T07:43:52.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T07:43:52.438 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec bash -c ' 2023-03-03T07:43:52.438 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2023-03-03T07:43:52.438 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-03-03T07:43:52.438 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-03-03T07:43:52.439 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-03-03T07:43:52.439 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-03-03T07:43:52.439 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-03-03T07:43:52.439 DEBUG:teuthology.orchestra.run.smithi057:> ') 2023-03-03T07:43:52.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T07:43:52.676 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec bash -c ' 2023-03-03T07:43:52.676 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2023-03-03T07:43:52.676 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link set brx.0 up 2023-03-03T07:43:52.677 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link set dev brx.0 master ceph-brx 2023-03-03T07:43:52.677 DEBUG:teuthology.orchestra.run.smithi057:> ') 2023-03-03T07:43:52.767 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-03-03T07:43:52.768 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-03-03T07:43:52.768 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-03-03T07:43:52.788 INFO:teuthology.orchestra.run.smithi057.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-03-03T07:43:52.789 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-03-03T07:43:52.789 DEBUG:teuthology.orchestra.run.smithi057:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-03-03T07:43:52.856 DEBUG:teuthology.orchestra.run.smithi057:> sudo modprobe fuse 2023-03-03T07:43:52.945 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-03-03T07:43:52.945 DEBUG:teuthology.orchestra.run.smithi057:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-03-03T07:43:53.033 INFO:teuthology.orchestra.run.smithi057.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-03-03T07:43:53.037 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-03-03T07:43:53.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T07:43:53.038 DEBUG:teuthology.orchestra.run.smithi057:> ls /sys/fs/fuse/connections 2023-03-03T07:43:53.101 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-03-03T07:43:53.102 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/) 2023-03-03T07:43:53.150 DEBUG:teuthology.orchestra.run.smithi057:> sudo modprobe fuse 2023-03-03T07:43:53.195 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-03-03T07:43:53.195 DEBUG:teuthology.orchestra.run.smithi057:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-03-03T07:43:53.285 INFO:teuthology.orchestra.run.smithi057.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-03-03T07:43:53.290 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-03-03T07:43:53.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T07:43:53.291 DEBUG:teuthology.orchestra.run.smithi057:> ls /sys/fs/fuse/connections 2023-03-03T07:43:53.332 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi057.stderr:2023-03-03T07:43:53.328+0000 7fb346836640 -1 init, newargv = 0x560a3d7ab7e0 newargc=15 2023-03-03T07:43:53.333 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi057.stderr:ceph-fuse[31101]: starting ceph client 2023-03-03T07:43:53.347 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi057.stderr:ceph-fuse[31101]: starting fuse 2023-03-03T07:43:53.350 INFO:teuthology.orchestra.run.smithi057.stdout:48 2023-03-03T07:43:53.350 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [48] 2023-03-03T07:43:53.351 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-03-03T07:43:53.351 DEBUG:teuthology.orchestra.run.smithi057:> import glob 2023-03-03T07:43:53.351 DEBUG:teuthology.orchestra.run.smithi057:> import re 2023-03-03T07:43:53.351 DEBUG:teuthology.orchestra.run.smithi057:> import os 2023-03-03T07:43:53.352 DEBUG:teuthology.orchestra.run.smithi057:> import subprocess 2023-03-03T07:43:53.352 DEBUG:teuthology.orchestra.run.smithi057:> 2023-03-03T07:43:53.352 DEBUG:teuthology.orchestra.run.smithi057:> def _find_admin_socket(client_name): 2023-03-03T07:43:53.352 DEBUG:teuthology.orchestra.run.smithi057:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-03-03T07:43:53.353 DEBUG:teuthology.orchestra.run.smithi057:> files = glob.glob(asok_path) 2023-03-03T07:43:53.353 DEBUG:teuthology.orchestra.run.smithi057:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-03-03T07:43:53.353 DEBUG:teuthology.orchestra.run.smithi057:> 2023-03-03T07:43:53.353 DEBUG:teuthology.orchestra.run.smithi057:> # Given a non-glob path, it better be there 2023-03-03T07:43:53.354 DEBUG:teuthology.orchestra.run.smithi057:> if "*" not in asok_path: 2023-03-03T07:43:53.354 DEBUG:teuthology.orchestra.run.smithi057:> assert(len(files) == 1) 2023-03-03T07:43:53.354 DEBUG:teuthology.orchestra.run.smithi057:> return files[0] 2023-03-03T07:43:53.354 DEBUG:teuthology.orchestra.run.smithi057:> 2023-03-03T07:43:53.355 DEBUG:teuthology.orchestra.run.smithi057:> for f in files: 2023-03-03T07:43:53.355 DEBUG:teuthology.orchestra.run.smithi057:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-03-03T07:43:53.355 DEBUG:teuthology.orchestra.run.smithi057:> if os.path.exists("/proc/{0}".format(pid)): 2023-03-03T07:43:53.355 DEBUG:teuthology.orchestra.run.smithi057:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-03-03T07:43:53.355 DEBUG:teuthology.orchestra.run.smithi057:> contents = proc_f.read() 2023-03-03T07:43:53.356 DEBUG:teuthology.orchestra.run.smithi057:> if mountpoint in contents: 2023-03-03T07:43:53.356 DEBUG:teuthology.orchestra.run.smithi057:> return f 2023-03-03T07:43:53.356 DEBUG:teuthology.orchestra.run.smithi057:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-03-03T07:43:53.357 DEBUG:teuthology.orchestra.run.smithi057:> 2023-03-03T07:43:53.357 DEBUG:teuthology.orchestra.run.smithi057:> print(_find_admin_socket("client.0")) 2023-03-03T07:43:53.357 DEBUG:teuthology.orchestra.run.smithi057:> ' 2023-03-03T07:43:53.529 INFO:teuthology.orchestra.run.smithi057.stdout:/var/run/ceph/ceph-client.0.31101.asok 2023-03-03T07:43:53.715 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.31101.asok 2023-03-03T07:43:53.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T07:43:53.715 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.31101.asok status 2023-03-03T07:43:53.944 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-03-03T07:43:53.945 INFO:teuthology.orchestra.run.smithi057.stdout: "metadata": { 2023-03-03T07:43:53.945 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_sha1": "472aaef4ec3b3a2c29f73ca67854785a910f1f9b", 2023-03-03T07:43:53.945 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_version": "ceph version 18.0.0-2739-g472aaef4 (472aaef4ec3b3a2c29f73ca67854785a910f1f9b) reef (dev)", 2023-03-03T07:43:53.945 INFO:teuthology.orchestra.run.smithi057.stdout: "entity_id": "0", 2023-03-03T07:43:53.945 INFO:teuthology.orchestra.run.smithi057.stdout: "hostname": "smithi057", 2023-03-03T07:43:53.945 INFO:teuthology.orchestra.run.smithi057.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-03-03T07:43:53.945 INFO:teuthology.orchestra.run.smithi057.stdout: "pid": "31101", 2023-03-03T07:43:53.946 INFO:teuthology.orchestra.run.smithi057.stdout: "root": "/" 2023-03-03T07:43:53.946 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-03-03T07:43:53.946 INFO:teuthology.orchestra.run.smithi057.stdout: "dentry_count": 0, 2023-03-03T07:43:53.946 INFO:teuthology.orchestra.run.smithi057.stdout: "dentry_pinned_count": 0, 2023-03-03T07:43:53.946 INFO:teuthology.orchestra.run.smithi057.stdout: "id": 4251, 2023-03-03T07:43:53.946 INFO:teuthology.orchestra.run.smithi057.stdout: "inst": { 2023-03-03T07:43:53.946 INFO:teuthology.orchestra.run.smithi057.stdout: "name": { 2023-03-03T07:43:53.946 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "client", 2023-03-03T07:43:53.947 INFO:teuthology.orchestra.run.smithi057.stdout: "num": 4251 2023-03-03T07:43:53.947 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-03-03T07:43:53.947 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": { 2023-03-03T07:43:53.947 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2023-03-03T07:43:53.947 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "192.168.0.1:0", 2023-03-03T07:43:53.947 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 3090977188 2023-03-03T07:43:53.947 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-03-03T07:43:53.948 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-03-03T07:43:53.948 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": { 2023-03-03T07:43:53.948 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2023-03-03T07:43:53.948 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "192.168.0.1:0", 2023-03-03T07:43:53.948 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 3090977188 2023-03-03T07:43:53.948 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-03-03T07:43:53.948 INFO:teuthology.orchestra.run.smithi057.stdout: "inst_str": "client.4251 192.168.0.1:0/3090977188", 2023-03-03T07:43:53.948 INFO:teuthology.orchestra.run.smithi057.stdout: "addr_str": "192.168.0.1:0/3090977188", 2023-03-03T07:43:53.949 INFO:teuthology.orchestra.run.smithi057.stdout: "inode_count": 1, 2023-03-03T07:43:53.949 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_epoch": 6, 2023-03-03T07:43:53.949 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_epoch": 16, 2023-03-03T07:43:53.949 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_epoch_barrier": 0, 2023-03-03T07:43:53.949 INFO:teuthology.orchestra.run.smithi057.stdout: "blocklisted": false, 2023-03-03T07:43:53.949 INFO:teuthology.orchestra.run.smithi057.stdout: "fs_name": "cephfs" 2023-03-03T07:43:53.949 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-03-03T07:43:53.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T07:43:53.967 DEBUG:teuthology.orchestra.run.smithi057:> stat --file-system '--printf=%T 2023-03-03T07:43:53.967 DEBUG:teuthology.orchestra.run.smithi057:> ' -- /home/ubuntu/cephtest/mnt.0 2023-03-03T07:43:53.986 INFO:teuthology.orchestra.run.smithi057.stdout:fuseblk 2023-03-03T07:43:53.987 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-03-03T07:43:53.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T07:43:53.988 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-03-03T07:43:54.078 INFO:teuthology.run_tasks:Running task workunit... 2023-03-03T07:43:54.096 INFO:tasks.workunit:Pulling workunits from ref 472aaef4ec3b3a2c29f73ca67854785a910f1f9b 2023-03-03T07:43:54.097 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-03-03T07:43:54.097 DEBUG:teuthology.orchestra.run.smithi057:> stat -- /home/ubuntu/cephtest/mnt.0 2023-03-03T07:43:54.144 INFO:teuthology.orchestra.run.smithi057.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-03-03T07:43:54.144 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2023-03-03T07:43:54.144 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 30h/48d Inode: 1 Links: 2 2023-03-03T07:43:54.144 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-03T07:43:54.144 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-03-03T07:43:54.145 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2023-03-03 07:43:36.360892601 +0000 2023-03-03T07:43:54.145 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2023-03-03 07:43:54.070906997 +0000 2023-03-03T07:43:54.145 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: - 2023-03-03T07:43:54.145 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-03-03T07:43:54.146 DEBUG:teuthology.orchestra.run.smithi057:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-03-03T07:43:54.254 INFO:tasks.workunit:timeout=3h 2023-03-03T07:43:54.254 INFO:tasks.workunit:cleanup=True 2023-03-03T07:43:54.255 DEBUG:teuthology.orchestra.run.smithi057:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 472aaef4ec3b3a2c29f73ca67854785a910f1f9b 2023-03-03T07:43:54.285 INFO:tasks.workunit.client.0.smithi057.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-03-03T07:44:03.911 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:44:33.994 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:44:52.301 INFO:tasks.workunit.client.0.smithi057.stderr:Updating files: 57% (6731/11620) Updating files: 58% (6740/11620) Updating files: 59% (6856/11620) Updating files: 60% (6972/11620) Updating files: 61% (7089/11620) Updating files: 62% (7205/11620) Updating files: 63% (7321/11620) Updating files: 64% (7437/11620) Updating files: 65% (7553/11620) Updating files: 66% (7670/11620) Updating files: 67% (7786/11620) Updating files: 68% (7902/11620) Updating files: 69% (8018/11620) Updating files: 70% (8134/11620) Updating files: 71% (8251/11620) Updating files: 72% (8367/11620) Updating files: 73% (8483/11620) Updating files: 74% (8599/11620) Updating files: 75% (8715/11620) Updating files: 76% (8832/11620) Updating files: 77% (8948/11620) Updating files: 78% (9064/11620) Updating files: 79% (9180/11620) Updating files: 80% (9296/11620) Updating files: 81% (9413/11620) Updating files: 82% (9529/11620) Updating files: 83% (9645/11620) Updating files: 84% (9761/11620) Updating files: 85% (9877/11620) Updating files: 86% (9994/11620) Updating files: 87% (10110/11620) Updating files: 88% (10226/11620) Updating files: 88% (10301/11620) Updating files: 89% (10342/11620) Updating files: 90% (10458/11620) Updating files: 91% (10575/11620) Updating files: 92% (10691/11620) Updating files: 93% (10807/11620) Updating files: 94% (10923/11620) Updating files: 95% (11039/11620) Updating files: 96% (11156/11620) Updating files: 97% (11272/11620) Updating files: 98% (11388/11620) Updating files: 99% (11504/11620) Updating files: 100% (11620/11620) Updating files: 100% (11620/11620), done. 2023-03-03T07:44:52.768 INFO:tasks.workunit.client.0.smithi057.stderr:Note: switching to '472aaef4ec3b3a2c29f73ca67854785a910f1f9b'. 2023-03-03T07:44:52.768 INFO:tasks.workunit.client.0.smithi057.stderr: 2023-03-03T07:44:52.769 INFO:tasks.workunit.client.0.smithi057.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-03-03T07:44:52.769 INFO:tasks.workunit.client.0.smithi057.stderr:changes and commit them, and you can discard any commits you make in this 2023-03-03T07:44:52.769 INFO:tasks.workunit.client.0.smithi057.stderr:state without impacting any branches by switching back to a branch. 2023-03-03T07:44:52.769 INFO:tasks.workunit.client.0.smithi057.stderr: 2023-03-03T07:44:52.769 INFO:tasks.workunit.client.0.smithi057.stderr:If you want to create a new branch to retain commits you create, you may 2023-03-03T07:44:52.769 INFO:tasks.workunit.client.0.smithi057.stderr:do so (now or later) by using -c with the switch command. Example: 2023-03-03T07:44:52.769 INFO:tasks.workunit.client.0.smithi057.stderr: 2023-03-03T07:44:52.770 INFO:tasks.workunit.client.0.smithi057.stderr: git switch -c 2023-03-03T07:44:52.770 INFO:tasks.workunit.client.0.smithi057.stderr: 2023-03-03T07:44:52.770 INFO:tasks.workunit.client.0.smithi057.stderr:Or undo this operation with: 2023-03-03T07:44:52.770 INFO:tasks.workunit.client.0.smithi057.stderr: 2023-03-03T07:44:52.770 INFO:tasks.workunit.client.0.smithi057.stderr: git switch - 2023-03-03T07:44:52.770 INFO:tasks.workunit.client.0.smithi057.stderr: 2023-03-03T07:44:52.770 INFO:tasks.workunit.client.0.smithi057.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-03-03T07:44:52.771 INFO:tasks.workunit.client.0.smithi057.stderr: 2023-03-03T07:44:52.771 INFO:tasks.workunit.client.0.smithi057.stderr:HEAD is now at 472aaef4ec3 Merge PR #45224 into wip-vshankar-testing-20230303.023823 2023-03-03T07:44:52.791 DEBUG:teuthology.orchestra.run.smithi057:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-03-03T07:44:52.831 INFO:tasks.workunit.client.0.smithi057.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-03-03T07:44:52.841 INFO:tasks.workunit.client.0.smithi057.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-03-03T07:44:52.841 INFO:tasks.workunit.client.0.smithi057.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-03-03T07:44:53.745 INFO:tasks.workunit.client.0.smithi057.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-03-03T07:44:53.898 INFO:tasks.workunit.client.0.smithi057.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-03-03T07:44:54.010 INFO:tasks.workunit.client.0.smithi057.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-03-03T07:44:54.019 INFO:tasks.workunit.client.0.smithi057.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-03-03T07:44:54.019 INFO:tasks.workunit.client.0.smithi057.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-03-03T07:44:54.133 INFO:tasks.workunit.client.0.smithi057.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-03-03T07:44:54.152 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-03-03T07:44:54.152 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-03-03T07:44:54.220 INFO:tasks.workunit:Running workunits matching fs/full/subvolume_rm.sh on client.0... 2023-03-03T07:44:54.221 INFO:tasks.workunit:Running workunit fs/full/subvolume_rm.sh... 2023-03-03T07:44:54.221 DEBUG:teuthology.orchestra.run.smithi057:workunit test fs/full/subvolume_rm.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=472aaef4ec3b3a2c29f73ca67854785a910f1f9b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/full/subvolume_rm.sh 2023-03-03T07:44:54.342 INFO:tasks.workunit.client.0.smithi057.stderr:+ set -e 2023-03-03T07:44:54.342 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph fs subvolume create cephfs sub_0 2023-03-03T07:44:54.513 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:54.508+0000 7fd801298700 1 Processor -- start 2023-03-03T07:44:54.513 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:54.508+0000 7fd801298700 1 -- start start 2023-03-03T07:44:54.514 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:54.508+0000 7fd801298700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd7fc123a60 0x7fd7fc123480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:44:54.514 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:54.508+0000 7fd801298700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7fc08d930 con 0x7fd7fc123e30 2023-03-03T07:44:54.514 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:54.508+0000 7fd801298700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7fc1242a0 con 0x7fd7fc123a60 2023-03-03T07:44:54.515 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:54.512+0000 7fd7f3fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fd7fc123e30 0x7fd7fc08afb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:49880/0 (socket says 172.21.15.57:49880) 2023-03-03T07:44:54.515 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:54.512+0000 7fd7f3fff700 1 -- 172.21.15.57:0/4168068555 learned_addr learned my addr 172.21.15.57:0/4168068555 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:44:54.515 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:54.512+0000 7fd7fbfff700 1 --2- 172.21.15.57:0/4168068555 >> v2:172.21.15.57:3300/0 conn(0x7fd7fc123a60 0x7fd7fc123480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:44:54.516 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:54.512+0000 7fd7fbfff700 1 -- 172.21.15.57:0/4168068555 >> v1:172.21.15.57:6789/0 conn(0x7fd7fc123e30 legacy=0x7fd7fc08afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:44:54.516 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:54.512+0000 7fd7fbfff700 1 -- 172.21.15.57:0/4168068555 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7fc124410 con 0x7fd7fc123a60 2023-03-03T07:44:54.516 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:54.512+0000 7fd7fb7fe700 1 -- 172.21.15.57:0/4168068555 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2337490128 0 0) 0x7fd7fc08d930 con 0x7fd7fc123e30 2023-03-03T07:44:54.517 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:54.512+0000 7fd7fbfff700 1 --2- 172.21.15.57:0/4168068555 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7fc123a60 0x7fd7fc123480 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec00a970 tx=0x7fd7ec00ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9f01198b8697f35 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:44:54.518 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:54.512+0000 7fd7fb7fe700 1 -- 172.21.15.57:0/4168068555 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd7ec00c970 con 0x7fd7fc123a60 2023-03-03T07:44:54.518 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:54.512+0000 7fd7fb7fe700 1 -- 172.21.15.57:0/4168068555 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7ec00cad0 con 0x7fd7fc123a60 2023-03-03T07:44:54.518 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:54.512+0000 7fd7fb7fe700 1 -- 172.21.15.57:0/4168068555 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd7ec00cd90 con 0x7fd7fc123a60 2023-03-03T07:44:54.519 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:54.516+0000 7fd801298700 1 -- 172.21.15.57:0/4168068555 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7fc123a60 msgr2=0x7fd7fc123480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:44:54.519 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:54.516+0000 7fd801298700 1 --2- 172.21.15.57:0/4168068555 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7fc123a60 0x7fd7fc123480 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec00a970 tx=0x7fd7ec00ac80 comp rx=0 tx=0).stop 2023-03-03T07:44:54.520 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:54.516+0000 7fd801298700 1 -- 172.21.15.57:0/4168068555 shutdown_connections 2023-03-03T07:44:54.520 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:54.516+0000 7fd801298700 1 --2- 172.21.15.57:0/4168068555 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7fc123a60 0x7fd7fc123480 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:44:54.520 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:54.516+0000 7fd801298700 1 -- 172.21.15.57:0/4168068555 >> 172.21.15.57:0/4168068555 conn(0x7fd7fc094b00 msgr2=0x7fd7fc094ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:44:54.520 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:54.516+0000 7fd801298700 1 -- 172.21.15.57:0/4168068555 shutdown_connections 2023-03-03T07:44:54.521 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:54.516+0000 7fd801298700 1 -- 172.21.15.57:0/4168068555 wait complete. 2023-03-03T07:44:54.522 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:54.516+0000 7fd801298700 1 Processor -- start 2023-03-03T07:44:54.523 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:54.516+0000 7fd801298700 1 -- start start 2023-03-03T07:44:54.523 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:54.520+0000 7fd801298700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7fc123a60 0x7fd7fc06f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:44:54.524 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:54.520+0000 7fd801298700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7fc071c10 con 0x7fd7fc123a60 2023-03-03T07:44:54.524 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:54.520+0000 7fd7fbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7fc123a60 0x7fd7fc06f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:44:54.524 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:54.520+0000 7fd7fbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7fc123a60 0x7fd7fc06f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50414/0 (socket says 172.21.15.57:50414) 2023-03-03T07:44:54.524 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:54.520+0000 7fd7fbfff700 1 -- 172.21.15.57:0/2357253597 learned_addr learned my addr 172.21.15.57:0/2357253597 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:44:54.525 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:54.520+0000 7fd7fbfff700 1 -- 172.21.15.57:0/2357253597 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7ec00a650 con 0x7fd7fc123a60 2023-03-03T07:44:54.525 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:54.520+0000 7fd7fbfff700 1 --2- 172.21.15.57:0/2357253597 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7fc123a60 0x7fd7fc06f190 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec00a1c0 tx=0x7fd7ec004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:44:54.526 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:54.520+0000 7fd7f97fa700 1 -- 172.21.15.57:0/2357253597 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd7ec01d070 con 0x7fd7fc123a60 2023-03-03T07:44:54.526 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:54.520+0000 7fd7f97fa700 1 -- 172.21.15.57:0/2357253597 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7ec003b10 con 0x7fd7fc123a60 2023-03-03T07:44:54.526 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:54.520+0000 7fd801298700 1 -- 172.21.15.57:0/2357253597 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7fc08b6c0 con 0x7fd7fc123a60 2023-03-03T07:44:54.526 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:54.520+0000 7fd7f97fa700 1 -- 172.21.15.57:0/2357253597 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd7ec003df0 con 0x7fd7fc123a60 2023-03-03T07:44:54.527 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:54.520+0000 7fd801298700 1 -- 172.21.15.57:0/2357253597 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7fc096100 con 0x7fd7fc123a60 2023-03-03T07:44:54.528 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:54.524+0000 7fd7f97fa700 1 -- 172.21.15.57:0/2357253597 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42205+0+0 (secure 0 0 0) 0x7fd7ec029030 con 0x7fd7fc123a60 2023-03-03T07:44:54.528 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:54.524+0000 7fd801298700 1 -- 172.21.15.57:0/2357253597 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7fc08b850 con 0x7fd7fc123a60 2023-03-03T07:44:54.529 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:54.524+0000 7fd7f97fa700 1 --2- 172.21.15.57:0/2357253597 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fd7dc0347f0 0x7fd7dc036ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:44:54.529 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:54.524+0000 7fd7f97fa700 1 -- 172.21.15.57:0/2357253597 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2928+0+0 (secure 0 0 0) 0x7fd7ec047840 con 0x7fd7fc123a60 2023-03-03T07:44:54.529 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:54.524+0000 7fd7f3fff700 1 --2- 172.21.15.57:0/2357253597 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fd7dc0347f0 0x7fd7dc036ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:44:54.531 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:54.524+0000 7fd7f3fff700 1 --2- 172.21.15.57:0/2357253597 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fd7dc0347f0 0x7fd7dc036ca0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4000c00 tx=0x7fd7e40079c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:44:54.537 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:54.532+0000 7fd7f97fa700 1 -- 172.21.15.57:0/2357253597 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd7ec020bf0 con 0x7fd7fc123a60 2023-03-03T07:44:54.740 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:54.736+0000 7fd801298700 1 -- 172.21.15.57:0/2357253597 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sub_0", "target": ["mon-mgr", ""]}) v1 -- 0x7fd7fc124410 con 0x7fd7dc0347f0 2023-03-03T07:44:54.751 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:44:54.744+0000 7fde62304700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-03T07:44:54.751 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:44:54.744+0000 7fde62304700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-03T07:44:54.751 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:44:54.744+0000 7fde62304700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-03T07:44:54.751 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:44:54.744+0000 7fde62304700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-03T07:44:54.752 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:44:54.744+0000 7fde62304700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-03T07:44:54.954 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:54.948+0000 7fd7f97fa700 1 -- 172.21.15.57:0/2357253597 <== mgr.4099 v2:172.21.15.57:6808/28565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fd7fc124410 con 0x7fd7dc0347f0 2023-03-03T07:44:55.084 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:55.080+0000 7fd801298700 1 -- 172.21.15.57:0/2357253597 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 1: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sub_0", "target": ["mon-mgr", ""]}) v1 -- 0x7fd7fc0619b0 con 0x7fd7dc0347f0 2023-03-03T07:44:55.095 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:55.092+0000 7fd7f97fa700 1 -- 172.21.15.57:0/2357253597 <== mgr.4099 v2:172.21.15.57:6808/28565 2 ==== mgr_command_reply(tid 1: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fd7fc0619b0 con 0x7fd7dc0347f0 2023-03-03T07:44:55.100 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:55.096+0000 7fd801298700 1 -- 172.21.15.57:0/2357253597 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fd7dc0347f0 msgr2=0x7fd7dc036ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:44:55.101 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:55.096+0000 7fd801298700 1 --2- 172.21.15.57:0/2357253597 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fd7dc0347f0 0x7fd7dc036ca0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4000c00 tx=0x7fd7e40079c0 comp rx=0 tx=0).stop 2023-03-03T07:44:55.101 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:55.096+0000 7fd801298700 1 -- 172.21.15.57:0/2357253597 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7fc123a60 msgr2=0x7fd7fc06f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:44:55.101 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:55.096+0000 7fd801298700 1 --2- 172.21.15.57:0/2357253597 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7fc123a60 0x7fd7fc06f190 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec00a1c0 tx=0x7fd7ec004770 comp rx=0 tx=0).stop 2023-03-03T07:44:55.102 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:55.096+0000 7fd801298700 1 -- 172.21.15.57:0/2357253597 shutdown_connections 2023-03-03T07:44:55.102 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:55.096+0000 7fd801298700 1 --2- 172.21.15.57:0/2357253597 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fd7dc0347f0 0x7fd7dc036ca0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:44:55.103 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:55.096+0000 7fd801298700 1 --2- 172.21.15.57:0/2357253597 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7fc123a60 0x7fd7fc06f190 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:44:55.103 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:55.096+0000 7fd801298700 1 -- 172.21.15.57:0/2357253597 >> 172.21.15.57:0/2357253597 conn(0x7fd7fc094b00 msgr2=0x7fd7fc120530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:44:55.103 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:55.096+0000 7fd801298700 1 -- 172.21.15.57:0/2357253597 shutdown_connections 2023-03-03T07:44:55.103 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:55.096+0000 7fd801298700 1 -- 172.21.15.57:0/2357253597 wait complete. 2023-03-03T07:44:55.134 INFO:tasks.workunit.client.0.smithi057.stderr:++ ceph fs subvolume getpath cephfs sub_0 2023-03-03T07:44:55.716 INFO:tasks.workunit.client.0.smithi057.stderr:+ subvol_path=/volumes/_nogroup/sub_0/1057bee9-a3a1-4c2b-9c3d-72885cad7add 2023-03-03T07:44:55.717 INFO:tasks.workunit.client.0.smithi057.stderr:+ echo 'Before write' 2023-03-03T07:44:55.717 INFO:tasks.workunit.client.0.smithi057.stdout:Before write 2023-03-03T07:44:55.717 INFO:tasks.workunit.client.0.smithi057.stderr:+ df -h 2023-03-03T07:44:55.735 INFO:tasks.workunit.client.0.smithi057.stdout:Filesystem Size Used Avail Use% Mounted on 2023-03-03T07:44:55.736 INFO:tasks.workunit.client.0.smithi057.stdout:udev 16G 0 16G 0% /dev 2023-03-03T07:44:55.736 INFO:tasks.workunit.client.0.smithi057.stdout:tmpfs 3.2G 1.9M 3.2G 1% /run 2023-03-03T07:44:55.736 INFO:tasks.workunit.client.0.smithi057.stdout:/dev/sda1 916G 17G 854G 2% / 2023-03-03T07:44:55.736 INFO:tasks.workunit.client.0.smithi057.stdout:tmpfs 16G 20K 16G 1% /dev/shm 2023-03-03T07:44:55.736 INFO:tasks.workunit.client.0.smithi057.stdout:tmpfs 5.0M 0 5.0M 0% /run/lock 2023-03-03T07:44:55.736 INFO:tasks.workunit.client.0.smithi057.stdout:tmpfs 16G 0 16G 0% /sys/fs/cgroup 2023-03-03T07:44:55.736 INFO:tasks.workunit.client.0.smithi057.stdout:tmpfs 3.2G 0 3.2G 0% /run/user/1000 2023-03-03T07:44:55.737 INFO:tasks.workunit.client.0.smithi057.stdout:/dev/mapper/vg_nvme-lv_5 15G 72M 15G 1% /var/lib/ceph 2023-03-03T07:44:55.737 INFO:tasks.workunit.client.0.smithi057.stdout:ceph-fuse 956M 0 956M 0% /home/ubuntu/cephtest/mnt.0 2023-03-03T07:44:55.737 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph osd df 2023-03-03T07:44:55.896 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:55.892+0000 7f03f25d2700 1 Processor -- start 2023-03-03T07:44:55.897 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:55.892+0000 7f03f25d2700 1 -- start start 2023-03-03T07:44:55.898 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:55.892+0000 7f03f25d2700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f03ec06d6e0 0x7f03ec06dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:44:55.899 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:55.896+0000 7f03f25d2700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03ec0714f0 con 0x7f03ec06dff0 2023-03-03T07:44:55.899 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:55.896+0000 7f03f25d2700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03ec06e490 con 0x7f03ec06d6e0 2023-03-03T07:44:55.899 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:55.896+0000 7f03f15d0700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f03ec06d6e0 0x7f03ec06dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:44:55.900 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:55.896+0000 7f03f15d0700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f03ec06d6e0 0x7f03ec06dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50458/0 (socket says 172.21.15.57:50458) 2023-03-03T07:44:55.900 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:55.896+0000 7f03f15d0700 1 -- 172.21.15.57:0/405830558 learned_addr learned my addr 172.21.15.57:0/405830558 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:44:55.900 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:55.896+0000 7f03f15d0700 1 -- 172.21.15.57:0/405830558 >> v1:172.21.15.57:6789/0 conn(0x7f03ec06dff0 legacy=0x7f03ec1298f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:44:55.901 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:55.896+0000 7f03f15d0700 1 -- 172.21.15.57:0/405830558 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03ec06a1c0 con 0x7f03ec06d6e0 2023-03-03T07:44:55.901 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:55.896+0000 7f03f15d0700 1 --2- 172.21.15.57:0/405830558 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03ec06d6e0 0x7f03ec06dab0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f03e8009890 tx=0x7f03e8009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae4cf56bc3d7b38d server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:44:55.902 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:55.896+0000 7f03e3fff700 1 -- 172.21.15.57:0/405830558 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03e8004160 con 0x7f03ec06d6e0 2023-03-03T07:44:55.902 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:55.896+0000 7f03e3fff700 1 -- 172.21.15.57:0/405830558 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e80042c0 con 0x7f03ec06d6e0 2023-03-03T07:44:55.902 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:55.896+0000 7f03e3fff700 1 -- 172.21.15.57:0/405830558 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03e8004580 con 0x7f03ec06d6e0 2023-03-03T07:44:55.904 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:55.900+0000 7f03f25d2700 1 -- 172.21.15.57:0/405830558 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03ec06d6e0 msgr2=0x7f03ec06dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:44:55.904 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:55.900+0000 7f03f25d2700 1 --2- 172.21.15.57:0/405830558 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03ec06d6e0 0x7f03ec06dab0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f03e8009890 tx=0x7f03e8009ba0 comp rx=0 tx=0).stop 2023-03-03T07:44:55.904 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:55.900+0000 7f03f25d2700 1 -- 172.21.15.57:0/405830558 shutdown_connections 2023-03-03T07:44:55.904 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:55.900+0000 7f03f25d2700 1 --2- 172.21.15.57:0/405830558 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03ec06d6e0 0x7f03ec06dab0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:44:55.904 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:55.900+0000 7f03f25d2700 1 -- 172.21.15.57:0/405830558 >> 172.21.15.57:0/405830558 conn(0x7f03ec095d80 msgr2=0x7f03ec096180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:44:55.905 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:55.900+0000 7f03f25d2700 1 -- 172.21.15.57:0/405830558 shutdown_connections 2023-03-03T07:44:55.905 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:55.900+0000 7f03f25d2700 1 -- 172.21.15.57:0/405830558 wait complete. 2023-03-03T07:44:55.907 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:55.904+0000 7f03f25d2700 1 Processor -- start 2023-03-03T07:44:55.908 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:55.904+0000 7f03f25d2700 1 -- start start 2023-03-03T07:44:55.909 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:55.904+0000 7f03f25d2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03ec06d6e0 0x7f03ec120e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:44:55.909 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:55.904+0000 7f03f25d2700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03ec121ea0 con 0x7f03ec06d6e0 2023-03-03T07:44:55.909 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:55.904+0000 7f03f15d0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03ec06d6e0 0x7f03ec120e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:44:55.910 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:55.904+0000 7f03f15d0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03ec06d6e0 0x7f03ec120e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50460/0 (socket says 172.21.15.57:50460) 2023-03-03T07:44:55.910 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:55.904+0000 7f03f15d0700 1 -- 172.21.15.57:0/3675012242 learned_addr learned my addr 172.21.15.57:0/3675012242 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:44:55.910 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:55.904+0000 7f03f15d0700 1 -- 172.21.15.57:0/3675012242 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e8009570 con 0x7f03ec06d6e0 2023-03-03T07:44:55.911 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:55.908+0000 7f03f15d0700 1 --2- 172.21.15.57:0/3675012242 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03ec06d6e0 0x7f03ec120e20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f03e8009be0 tx=0x7f03e8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:44:55.911 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:55.908+0000 7f03e1ffb700 1 -- 172.21.15.57:0/3675012242 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03e800b670 con 0x7f03ec06d6e0 2023-03-03T07:44:55.911 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:55.908+0000 7f03e1ffb700 1 -- 172.21.15.57:0/3675012242 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e800b7d0 con 0x7f03ec06d6e0 2023-03-03T07:44:55.912 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:55.908+0000 7f03e1ffb700 1 -- 172.21.15.57:0/3675012242 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03e800ba70 con 0x7f03ec06d6e0 2023-03-03T07:44:55.912 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:55.908+0000 7f03f25d2700 1 -- 172.21.15.57:0/3675012242 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03ec12b220 con 0x7f03ec06d6e0 2023-03-03T07:44:55.912 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:55.908+0000 7f03f25d2700 1 -- 172.21.15.57:0/3675012242 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03ec097180 con 0x7f03ec06d6e0 2023-03-03T07:44:55.913 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:55.908+0000 7f03f25d2700 1 -- 172.21.15.57:0/3675012242 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03ec12b3b0 con 0x7f03ec06d6e0 2023-03-03T07:44:55.914 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:55.908+0000 7f03e1ffb700 1 -- 172.21.15.57:0/3675012242 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 42245+0+0 (secure 0 0 0) 0x7f03e8017020 con 0x7f03ec06d6e0 2023-03-03T07:44:55.915 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:55.912+0000 7f03e1ffb700 1 --2- 172.21.15.57:0/3675012242 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f03d00347f0 0x7f03d0036ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:44:55.915 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:55.912+0000 7f03e1ffb700 1 -- 172.21.15.57:0/3675012242 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2928+0+0 (secure 0 0 0) 0x7f03e8047e00 con 0x7f03ec06d6e0 2023-03-03T07:44:55.916 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:55.912+0000 7f03f0dcf700 1 --2- 172.21.15.57:0/3675012242 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f03d00347f0 0x7f03d0036ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:44:55.917 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:55.912+0000 7f03f0dcf700 1 --2- 172.21.15.57:0/3675012242 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f03d00347f0 0x7f03d0036ca0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f03dc001620 tx=0x7f03dc007b00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:44:55.925 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:55.920+0000 7f03e1ffb700 1 -- 172.21.15.57:0/3675012242 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f03e8006c80 con 0x7f03ec06d6e0 2023-03-03T07:44:56.100 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:56.096+0000 7f03f25d2700 1 -- 172.21.15.57:0/3675012242 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 0: {"prefix": "osd df", "target": ["mon-mgr", ""]}) v1 -- 0x7f03ec0619b0 con 0x7f03d00347f0 2023-03-03T07:44:56.101 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:56.096+0000 7f03e1ffb700 1 -- 172.21.15.57:0/3675012242 <== mgr.4099 v2:172.21.15.57:6808/28565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+343 (secure 0 0 0) 0x7f03ec0619b0 con 0x7f03d00347f0 2023-03-03T07:44:56.195 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:56.192+0000 7f03f25d2700 1 -- 172.21.15.57:0/3675012242 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 1: {"prefix": "osd df", "target": ["mon-mgr", ""]}) v1 -- 0x7f03ec121fe0 con 0x7f03d00347f0 2023-03-03T07:44:56.196 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:56.192+0000 7f03e1ffb700 1 -- 172.21.15.57:0/3675012242 <== mgr.4099 v2:172.21.15.57:6808/28565 2 ==== mgr_command_reply(tid 1: 0 ) v1 ==== 8+0+343 (secure 0 0 0) 0x7f03ec121fe0 con 0x7f03d00347f0 2023-03-03T07:44:56.196 INFO:tasks.workunit.client.0.smithi057.stdout:ID CLASS WEIGHT REWEIGHT SIZE RAW USE DATA OMAP META AVAIL %USE VAR PGS STATUS 2023-03-03T07:44:56.196 INFO:tasks.workunit.client.0.smithi057.stdout: 0 ssd 0.00099 1.00000 1 GiB 13 MiB 752 KiB 0 B 12 MiB 1011 MiB 1.28 1.00 105 up 2023-03-03T07:44:56.197 INFO:tasks.workunit.client.0.smithi057.stdout: TOTAL 1 GiB 13 MiB 752 KiB 0 B 12 MiB 1011 MiB 1.28 2023-03-03T07:44:56.197 INFO:tasks.workunit.client.0.smithi057.stdout:MIN/MAX VAR: 1.00/1.00 STDDEV: 0 2023-03-03T07:44:56.200 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:56.196+0000 7f03f25d2700 1 -- 172.21.15.57:0/3675012242 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f03d00347f0 msgr2=0x7f03d0036ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:44:56.200 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:56.196+0000 7f03f25d2700 1 --2- 172.21.15.57:0/3675012242 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f03d00347f0 0x7f03d0036ca0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f03dc001620 tx=0x7f03dc007b00 comp rx=0 tx=0).stop 2023-03-03T07:44:56.201 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:56.196+0000 7f03f25d2700 1 -- 172.21.15.57:0/3675012242 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03ec06d6e0 msgr2=0x7f03ec120e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:44:56.201 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:56.196+0000 7f03f25d2700 1 --2- 172.21.15.57:0/3675012242 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03ec06d6e0 0x7f03ec120e20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f03e8009be0 tx=0x7f03e8004770 comp rx=0 tx=0).stop 2023-03-03T07:44:56.201 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:56.196+0000 7f03f25d2700 1 -- 172.21.15.57:0/3675012242 shutdown_connections 2023-03-03T07:44:56.201 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:56.196+0000 7f03f25d2700 1 --2- 172.21.15.57:0/3675012242 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f03d00347f0 0x7f03d0036ca0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:44:56.201 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:56.196+0000 7f03f25d2700 1 --2- 172.21.15.57:0/3675012242 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03ec06d6e0 0x7f03ec120e20 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:44:56.201 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:56.196+0000 7f03f25d2700 1 -- 172.21.15.57:0/3675012242 >> 172.21.15.57:0/3675012242 conn(0x7f03ec095d80 msgr2=0x7f03ec06c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:44:56.202 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:56.196+0000 7f03f25d2700 1 -- 172.21.15.57:0/3675012242 shutdown_connections 2023-03-03T07:44:56.202 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:44:56.196+0000 7f03f25d2700 1 -- 172.21.15.57:0/3675012242 wait complete. 2023-03-03T07:44:56.227 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/1057bee9-a3a1-4c2b-9c3d-72885cad7add/500MB_file-1 status=progress bs=1M count=500 2023-03-03T07:45:03.399 INFO:tasks.workunit.client.0.smithi057.stderr: 57671680 bytes (58 MB, 55 MiB) copied, 1 s, 57.0 MB/s 118489088 bytes (118 MB, 113 MiB) copied, 2 s, 59.1 MB/s 178257920 bytes (178 MB, 170 MiB) copied, 3 s, 59.3 MB/s 246415360 bytes (246 MB, 235 MiB) copied, 4 s, 61.5 MB/s 333447168 bytes (333 MB, 318 MiB) copied, 5 s, 66.6 MB/s 424673280 bytes (425 MB, 405 MiB) copied, 6 s, 70.8 MB/s 512753664 bytes (513 MB, 489 MiB) copied, 7 s, 73.2 MB/s 2023-03-03T07:45:03.400 INFO:tasks.workunit.client.0.smithi057.stderr:500+0 records in 2023-03-03T07:45:03.400 INFO:tasks.workunit.client.0.smithi057.stderr:500+0 records out 2023-03-03T07:45:03.400 INFO:tasks.workunit.client.0.smithi057.stderr:524288000 bytes (524 MB, 500 MiB) copied, 7.13575 s, 73.5 MB/s 2023-03-03T07:45:03.404 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph osd set-full-ratio 0.2 2023-03-03T07:45:03.577 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:03.572+0000 7f6f2ea66700 1 Processor -- start 2023-03-03T07:45:03.578 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:03.572+0000 7f6f2ea66700 1 -- start start 2023-03-03T07:45:03.579 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:03.576+0000 7f6f2ea66700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6f28091de0 0x7f6f2808ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:45:03.579 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:03.576+0000 7f6f2ea66700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f280911f0 con 0x7f6f28091a10 2023-03-03T07:45:03.579 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:03.576+0000 7f6f2ea66700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f280662f0 con 0x7f6f28091de0 2023-03-03T07:45:03.580 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:03.576+0000 7f6f2d263700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6f28091de0 0x7f6f2808ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:45:03.580 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:03.576+0000 7f6f2d263700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6f28091de0 0x7f6f2808ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34438/0 (socket says 172.21.15.57:34438) 2023-03-03T07:45:03.580 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:03.576+0000 7f6f2d263700 1 -- 172.21.15.57:0/353567949 learned_addr learned my addr 172.21.15.57:0/353567949 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:45:03.580 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:03.576+0000 7f6f2da64700 1 --1- 172.21.15.57:0/353567949 >> v1:172.21.15.57:6789/0 conn(0x7f6f28091a10 0x7f6f2808e730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57338/0 (socket says 172.21.15.57:57338) 2023-03-03T07:45:03.581 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:03.576+0000 7f6f2d263700 1 -- 172.21.15.57:0/353567949 >> v1:172.21.15.57:6789/0 conn(0x7f6f28091a10 legacy=0x7f6f2808e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:45:03.581 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:03.576+0000 7f6f2d263700 1 -- 172.21.15.57:0/353567949 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f28066700 con 0x7f6f28091de0 2023-03-03T07:45:03.581 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:03.576+0000 7f6f2d263700 1 --2- 172.21.15.57:0/353567949 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f28091de0 0x7f6f2808ee40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6f18009890 tx=0x7f6f18009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12afed7d6d623399 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:45:03.582 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:03.576+0000 7f6f2ca62700 1 -- 172.21.15.57:0/353567949 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f18004160 con 0x7f6f28091de0 2023-03-03T07:45:03.582 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:03.576+0000 7f6f2ca62700 1 -- 172.21.15.57:0/353567949 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f180042c0 con 0x7f6f28091de0 2023-03-03T07:45:03.582 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:03.576+0000 7f6f2ca62700 1 -- 172.21.15.57:0/353567949 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f18004580 con 0x7f6f28091de0 2023-03-03T07:45:03.583 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:03.576+0000 7f6f2ea66700 1 -- 172.21.15.57:0/353567949 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f28091de0 msgr2=0x7f6f2808ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:45:03.583 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:03.576+0000 7f6f2ea66700 1 --2- 172.21.15.57:0/353567949 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f28091de0 0x7f6f2808ee40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6f18009890 tx=0x7f6f18009ba0 comp rx=0 tx=0).stop 2023-03-03T07:45:03.583 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:03.576+0000 7f6f2ea66700 1 -- 172.21.15.57:0/353567949 shutdown_connections 2023-03-03T07:45:03.583 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:03.576+0000 7f6f2ea66700 1 --2- 172.21.15.57:0/353567949 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f28091de0 0x7f6f2808ee40 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:45:03.583 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:03.576+0000 7f6f2ea66700 1 -- 172.21.15.57:0/353567949 >> 172.21.15.57:0/353567949 conn(0x7f6f2808a3c0 msgr2=0x7f6f2808c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:45:03.584 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:03.580+0000 7f6f2ea66700 1 -- 172.21.15.57:0/353567949 shutdown_connections 2023-03-03T07:45:03.584 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:03.580+0000 7f6f2ea66700 1 -- 172.21.15.57:0/353567949 wait complete. 2023-03-03T07:45:03.586 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:03.580+0000 7f6f2ea66700 1 Processor -- start 2023-03-03T07:45:03.587 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:03.580+0000 7f6f2ea66700 1 -- start start 2023-03-03T07:45:03.587 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:03.584+0000 7f6f2ea66700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f28091a10 0x7f6f28124cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:45:03.588 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:03.584+0000 7f6f2ea66700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f281277f0 con 0x7f6f28091a10 2023-03-03T07:45:03.588 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:03.584+0000 7f6f2da64700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f28091a10 0x7f6f28124cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:45:03.588 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:03.584+0000 7f6f2da64700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f28091a10 0x7f6f28124cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34450/0 (socket says 172.21.15.57:34450) 2023-03-03T07:45:03.588 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:03.584+0000 7f6f2da64700 1 -- 172.21.15.57:0/427591679 learned_addr learned my addr 172.21.15.57:0/427591679 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:45:03.589 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:03.584+0000 7f6f2da64700 1 -- 172.21.15.57:0/427591679 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f18009570 con 0x7f6f28091a10 2023-03-03T07:45:03.589 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:03.584+0000 7f6f2da64700 1 --2- 172.21.15.57:0/427591679 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f28091a10 0x7f6f28124cf0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6f2400c480 tx=0x7f6f2400c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:45:03.590 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:03.584+0000 7f6f1e7fc700 1 -- 172.21.15.57:0/427591679 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f24005c00 con 0x7f6f28091a10 2023-03-03T07:45:03.590 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:03.584+0000 7f6f1e7fc700 1 -- 172.21.15.57:0/427591679 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f24005d60 con 0x7f6f28091a10 2023-03-03T07:45:03.590 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:03.584+0000 7f6f1e7fc700 1 -- 172.21.15.57:0/427591679 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f240070d0 con 0x7f6f28091a10 2023-03-03T07:45:03.590 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:03.584+0000 7f6f2ea66700 1 -- 172.21.15.57:0/427591679 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f28090f00 con 0x7f6f28091a10 2023-03-03T07:45:03.590 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:03.584+0000 7f6f2ea66700 1 -- 172.21.15.57:0/427591679 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f2808f590 con 0x7f6f28091a10 2023-03-03T07:45:03.592 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:03.588+0000 7f6f2ea66700 1 -- 172.21.15.57:0/427591679 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f2812d720 con 0x7f6f28091a10 2023-03-03T07:45:03.592 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:03.588+0000 7f6f1e7fc700 1 -- 172.21.15.57:0/427591679 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 42245+0+0 (secure 0 0 0) 0x7f6f24019030 con 0x7f6f28091a10 2023-03-03T07:45:03.594 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:03.588+0000 7f6f1e7fc700 1 --2- 172.21.15.57:0/427591679 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f6f0c034800 0x7f6f0c036cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:45:03.594 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:03.588+0000 7f6f1e7fc700 1 -- 172.21.15.57:0/427591679 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2928+0+0 (secure 0 0 0) 0x7f6f24045390 con 0x7f6f28091a10 2023-03-03T07:45:03.594 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:03.588+0000 7f6f2d263700 1 --2- 172.21.15.57:0/427591679 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f6f0c034800 0x7f6f0c036cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:45:03.595 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:03.592+0000 7f6f2d263700 1 --2- 172.21.15.57:0/427591679 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f6f0c034800 0x7f6f0c036cb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6f18009890 tx=0x7f6f18008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:45:03.601 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:03.596+0000 7f6f1e7fc700 1 -- 172.21.15.57:0/427591679 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6f24011540 con 0x7f6f28091a10 2023-03-03T07:45:03.785 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:03.780+0000 7f6f2ea66700 1 -- 172.21.15.57:0/427591679 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd set-full-ratio", "ratio": 0.2} v 0) v1 -- 0x7f6f28127b70 con 0x7f6f28091a10 2023-03-03T07:45:04.068 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:45:04.293 INFO:tasks.ceph.mon.a.smithi057.stderr:2023-03-03T07:45:04.288+0000 7fcc0ddf9700 -1 log_channel(cluster) log [ERR] : Health check failed: full ratio(s) out of order (OSD_OUT_OF_ORDER_FULL) 2023-03-03T07:45:04.307 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:04.304+0000 7f6f1e7fc700 1 -- 172.21.15.57:0/427591679 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd set-full-ratio", "ratio": 0.2}]=0 osd set-full-ratio 0.2 v17) v1 ==== 102+0+0 (secure 0 0 0) 0x7f6f24017020 con 0x7f6f28091a10 2023-03-03T07:45:04.419 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:04.416+0000 7f6f2ea66700 1 -- 172.21.15.57:0/427591679 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd set-full-ratio", "ratio": 0.2} v 0) v1 -- 0x7f6f28127420 con 0x7f6f28091a10 2023-03-03T07:45:05.313 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:05.308+0000 7f6f1e7fc700 1 -- 172.21.15.57:0/427591679 <== mon.0 v2:172.21.15.57:3300/0 8 ==== mon_command_ack([{"prefix": "osd set-full-ratio", "ratio": 0.2}]=0 osd set-full-ratio 0.2 v18) v1 ==== 102+0+0 (secure 0 0 0) 0x7f6f24011360 con 0x7f6f28091a10 2023-03-03T07:45:05.318 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:05.312+0000 7f6f2ea66700 1 -- 172.21.15.57:0/427591679 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f6f0c034800 msgr2=0x7f6f0c036cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:45:05.318 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:05.312+0000 7f6f2ea66700 1 --2- 172.21.15.57:0/427591679 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f6f0c034800 0x7f6f0c036cb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6f18009890 tx=0x7f6f18008030 comp rx=0 tx=0).stop 2023-03-03T07:45:05.318 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:05.312+0000 7f6f2ea66700 1 -- 172.21.15.57:0/427591679 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f28091a10 msgr2=0x7f6f28124cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:45:05.318 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:05.312+0000 7f6f2ea66700 1 --2- 172.21.15.57:0/427591679 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f28091a10 0x7f6f28124cf0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6f2400c480 tx=0x7f6f2400c840 comp rx=0 tx=0).stop 2023-03-03T07:45:05.319 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:05.312+0000 7f6f2ea66700 1 -- 172.21.15.57:0/427591679 shutdown_connections 2023-03-03T07:45:05.319 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:05.312+0000 7f6f2ea66700 1 --2- 172.21.15.57:0/427591679 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f6f0c034800 0x7f6f0c036cb0 secure :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6f18009890 tx=0x7f6f18008030 comp rx=0 tx=0).stop 2023-03-03T07:45:05.319 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:05.312+0000 7f6f2ea66700 1 --2- 172.21.15.57:0/427591679 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f28091a10 0x7f6f28124cf0 secure :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6f2400c480 tx=0x7f6f2400c840 comp rx=0 tx=0).stop 2023-03-03T07:45:05.319 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:05.312+0000 7f6f2ea66700 1 -- 172.21.15.57:0/427591679 >> 172.21.15.57:0/427591679 conn(0x7f6f2808a3c0 msgr2=0x7f6f2812cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:45:05.320 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:05.316+0000 7f6f2ea66700 1 -- 172.21.15.57:0/427591679 shutdown_connections 2023-03-03T07:45:05.320 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:05.316+0000 7f6f2ea66700 1 -- 172.21.15.57:0/427591679 wait complete. 2023-03-03T07:45:05.324 INFO:tasks.workunit.client.0.smithi057.stderr:osd set-full-ratio 0.2 2023-03-03T07:45:05.348 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph osd set-nearfull-ratio 0.16 2023-03-03T07:45:05.518 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:05.512+0000 7f05e759e700 1 Processor -- start 2023-03-03T07:45:05.518 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:05.512+0000 7f05e759e700 1 -- start start 2023-03-03T07:45:05.521 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:05.516+0000 7f05e759e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f05e8091a10 0x7f05e808e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:45:05.522 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:05.516+0000 7f05e759e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05e80911f0 con 0x7f05e8091de0 2023-03-03T07:45:05.522 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:05.516+0000 7f05e759e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05e80662f0 con 0x7f05e8091a10 2023-03-03T07:45:05.522 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:05.516+0000 7f05e659c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f05e8091a10 0x7f05e808e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:45:05.523 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:05.516+0000 7f05e659c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f05e8091a10 0x7f05e808e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34466/0 (socket says 172.21.15.57:34466) 2023-03-03T07:45:05.523 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:05.516+0000 7f05e659c700 1 -- 172.21.15.57:0/2971612201 learned_addr learned my addr 172.21.15.57:0/2971612201 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:45:05.523 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:05.520+0000 7f05e659c700 1 -- 172.21.15.57:0/2971612201 >> v1:172.21.15.57:6789/0 conn(0x7f05e8091de0 legacy=0x7f05e808ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:45:05.523 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:05.520+0000 7f05e659c700 1 -- 172.21.15.57:0/2971612201 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e8066700 con 0x7f05e8091a10 2023-03-03T07:45:05.524 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:05.520+0000 7f05e659c700 1 --2- 172.21.15.57:0/2971612201 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05e8091a10 0x7f05e808e730 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f05d8009890 tx=0x7f05d8009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5839e79b227b92e server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:45:05.524 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:05.520+0000 7f05e559a700 1 -- 172.21.15.57:0/2971612201 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05d8004160 con 0x7f05e8091a10 2023-03-03T07:45:05.524 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:05.520+0000 7f05e559a700 1 -- 172.21.15.57:0/2971612201 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d80042c0 con 0x7f05e8091a10 2023-03-03T07:45:05.524 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:05.520+0000 7f05e559a700 1 -- 172.21.15.57:0/2971612201 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05d8004580 con 0x7f05e8091a10 2023-03-03T07:45:05.525 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:05.520+0000 7f05e759e700 1 -- 172.21.15.57:0/2971612201 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05e8091a10 msgr2=0x7f05e808e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:45:05.525 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:05.520+0000 7f05e759e700 1 --2- 172.21.15.57:0/2971612201 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05e8091a10 0x7f05e808e730 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f05d8009890 tx=0x7f05d8009ba0 comp rx=0 tx=0).stop 2023-03-03T07:45:05.527 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:05.524+0000 7f05e759e700 1 -- 172.21.15.57:0/2971612201 shutdown_connections 2023-03-03T07:45:05.527 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:05.524+0000 7f05e759e700 1 --2- 172.21.15.57:0/2971612201 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05e8091a10 0x7f05e808e730 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:45:05.527 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:05.524+0000 7f05e759e700 1 -- 172.21.15.57:0/2971612201 >> 172.21.15.57:0/2971612201 conn(0x7f05e808a3c0 msgr2=0x7f05e808c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:45:05.527 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:05.524+0000 7f05e759e700 1 -- 172.21.15.57:0/2971612201 shutdown_connections 2023-03-03T07:45:05.527 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:05.524+0000 7f05e759e700 1 -- 172.21.15.57:0/2971612201 wait complete. 2023-03-03T07:45:05.530 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:05.524+0000 7f05e759e700 1 Processor -- start 2023-03-03T07:45:05.531 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:05.528+0000 7f05e759e700 1 -- start start 2023-03-03T07:45:05.531 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:05.528+0000 7f05e759e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05e8091a10 0x7f05e81bc040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:45:05.532 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:05.528+0000 7f05e759e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e8128540 con 0x7f05e8091a10 2023-03-03T07:45:05.532 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:05.528+0000 7f05e659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05e8091a10 0x7f05e81bc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:45:05.532 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:05.528+0000 7f05e659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05e8091a10 0x7f05e81bc040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34478/0 (socket says 172.21.15.57:34478) 2023-03-03T07:45:05.532 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:05.528+0000 7f05e659c700 1 -- 172.21.15.57:0/1978973297 learned_addr learned my addr 172.21.15.57:0/1978973297 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:45:05.533 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:05.528+0000 7f05e659c700 1 -- 172.21.15.57:0/1978973297 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d8009570 con 0x7f05e8091a10 2023-03-03T07:45:05.533 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:05.528+0000 7f05e659c700 1 --2- 172.21.15.57:0/1978973297 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05e8091a10 0x7f05e81bc040 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f05d8009fd0 tx=0x7f05d8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:45:05.534 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:05.528+0000 7f05d6ffd700 1 -- 172.21.15.57:0/1978973297 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05d800b670 con 0x7f05e8091a10 2023-03-03T07:45:05.534 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:05.528+0000 7f05d6ffd700 1 -- 172.21.15.57:0/1978973297 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d800b7d0 con 0x7f05e8091a10 2023-03-03T07:45:05.534 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:05.528+0000 7f05d6ffd700 1 -- 172.21.15.57:0/1978973297 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05d800ba70 con 0x7f05e8091a10 2023-03-03T07:45:05.534 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:05.528+0000 7f05e759e700 1 -- 172.21.15.57:0/1978973297 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05e8090f00 con 0x7f05e8091a10 2023-03-03T07:45:05.535 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:05.528+0000 7f05e759e700 1 -- 172.21.15.57:0/1978973297 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05e808f590 con 0x7f05e8091a10 2023-03-03T07:45:05.536 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:05.532+0000 7f05e759e700 1 -- 172.21.15.57:0/1978973297 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05e812d720 con 0x7f05e8091a10 2023-03-03T07:45:05.536 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:05.532+0000 7f05d6ffd700 1 -- 172.21.15.57:0/1978973297 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 42245+0+0 (secure 0 0 0) 0x7f05d8017020 con 0x7f05e8091a10 2023-03-03T07:45:05.537 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:05.532+0000 7f05d6ffd700 1 --2- 172.21.15.57:0/1978973297 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f05c8034800 0x7f05c8036cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:45:05.537 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:05.532+0000 7f05d6ffd700 1 -- 172.21.15.57:0/1978973297 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 2928+0+0 (secure 0 0 0) 0x7f05d8047a40 con 0x7f05e8091a10 2023-03-03T07:45:05.538 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:05.532+0000 7f05e5d9b700 1 --2- 172.21.15.57:0/1978973297 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f05c8034800 0x7f05c8036cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:45:05.539 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:05.536+0000 7f05e5d9b700 1 --2- 172.21.15.57:0/1978973297 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f05c8034800 0x7f05c8036cb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f05e8092210 tx=0x7f05dc007b00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:45:05.543 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:05.540+0000 7f05d6ffd700 1 -- 172.21.15.57:0/1978973297 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f05d800bbd0 con 0x7f05e8091a10 2023-03-03T07:45:05.725 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:05.720+0000 7f05e759e700 1 -- 172.21.15.57:0/1978973297 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd set-nearfull-ratio", "ratio": 0.16} v 0) v1 -- 0x7f05e811f060 con 0x7f05e8091a10 2023-03-03T07:45:06.326 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:06.320+0000 7f05d6ffd700 1 -- 172.21.15.57:0/1978973297 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd set-nearfull-ratio", "ratio": 0.16}]=0 osd set-nearfull-ratio 0.16 v19) v1 ==== 112+0+0 (secure 0 0 0) 0x7f05d802cbe0 con 0x7f05e8091a10 2023-03-03T07:45:06.438 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:06.432+0000 7f05e759e700 1 -- 172.21.15.57:0/1978973297 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd set-nearfull-ratio", "ratio": 0.16} v 0) v1 -- 0x7f05e811f060 con 0x7f05e8091a10 2023-03-03T07:45:07.331 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:07.324+0000 7f05d6ffd700 1 -- 172.21.15.57:0/1978973297 <== mon.0 v2:172.21.15.57:3300/0 8 ==== mon_command_ack([{"prefix": "osd set-nearfull-ratio", "ratio": 0.16}]=0 osd set-nearfull-ratio 0.16 v20) v1 ==== 112+0+0 (secure 0 0 0) 0x7f05d8031030 con 0x7f05e8091a10 2023-03-03T07:45:07.336 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:07.332+0000 7f05e759e700 1 -- 172.21.15.57:0/1978973297 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f05c8034800 msgr2=0x7f05c8036cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:45:07.337 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:07.332+0000 7f05e759e700 1 --2- 172.21.15.57:0/1978973297 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f05c8034800 0x7f05c8036cb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f05e8092210 tx=0x7f05dc007b00 comp rx=0 tx=0).stop 2023-03-03T07:45:07.337 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:07.332+0000 7f05e759e700 1 -- 172.21.15.57:0/1978973297 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05e8091a10 msgr2=0x7f05e81bc040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:45:07.337 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:07.332+0000 7f05e759e700 1 --2- 172.21.15.57:0/1978973297 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05e8091a10 0x7f05e81bc040 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f05d8009fd0 tx=0x7f05d8004770 comp rx=0 tx=0).stop 2023-03-03T07:45:07.337 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:07.332+0000 7f05e759e700 1 -- 172.21.15.57:0/1978973297 shutdown_connections 2023-03-03T07:45:07.337 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:07.332+0000 7f05e759e700 1 --2- 172.21.15.57:0/1978973297 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f05c8034800 0x7f05c8036cb0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:45:07.337 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:07.332+0000 7f05e759e700 1 --2- 172.21.15.57:0/1978973297 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05e8091a10 0x7f05e81bc040 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:45:07.338 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:07.332+0000 7f05e759e700 1 -- 172.21.15.57:0/1978973297 >> 172.21.15.57:0/1978973297 conn(0x7f05e808a3c0 msgr2=0x7f05e812cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:45:07.338 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:07.332+0000 7f05e759e700 1 -- 172.21.15.57:0/1978973297 shutdown_connections 2023-03-03T07:45:07.338 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:07.332+0000 7f05e759e700 1 -- 172.21.15.57:0/1978973297 wait complete. 2023-03-03T07:45:07.340 INFO:tasks.workunit.client.0.smithi057.stderr:osd set-nearfull-ratio 0.16 2023-03-03T07:45:07.364 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph osd set-backfillfull-ratio 0.18 2023-03-03T07:45:07.527 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:07.524+0000 7fe9521ba700 1 Processor -- start 2023-03-03T07:45:07.528 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:07.524+0000 7fe9521ba700 1 -- start start 2023-03-03T07:45:07.530 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:07.524+0000 7fe9521ba700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe94c08eeb0 0x7fe94c1242b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:45:07.530 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:07.524+0000 7fe9521ba700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe94c08fa50 con 0x7fe94c092f80 2023-03-03T07:45:07.530 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:07.524+0000 7fe9521ba700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe94c06a840 con 0x7fe94c08eeb0 2023-03-03T07:45:07.531 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:07.524+0000 7fe94affd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe94c08eeb0 0x7fe94c1242b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:45:07.531 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:07.524+0000 7fe94affd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe94c08eeb0 0x7fe94c1242b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34490/0 (socket says 172.21.15.57:34490) 2023-03-03T07:45:07.531 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:07.524+0000 7fe94affd700 1 -- 172.21.15.57:0/1211535580 learned_addr learned my addr 172.21.15.57:0/1211535580 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:45:07.531 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:07.524+0000 7fe94b7fe700 1 --1- 172.21.15.57:0/1211535580 >> v1:172.21.15.57:6789/0 conn(0x7fe94c092f80 0x7fe94c123ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57364/0 (socket says 172.21.15.57:57364) 2023-03-03T07:45:07.532 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:07.524+0000 7fe94affd700 1 -- 172.21.15.57:0/1211535580 >> v1:172.21.15.57:6789/0 conn(0x7fe94c092f80 legacy=0x7fe94c123ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:45:07.532 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:07.524+0000 7fe94affd700 1 -- 172.21.15.57:0/1211535580 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe94c06ab50 con 0x7fe94c08eeb0 2023-03-03T07:45:07.534 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:07.524+0000 7fe94affd700 1 --2- 172.21.15.57:0/1211535580 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe94c08eeb0 0x7fe94c1242b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe940009aa0 tx=0x7fe940009db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0c262b310b4e33e server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:45:07.534 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:07.528+0000 7fe94a7fc700 1 -- 172.21.15.57:0/1211535580 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe94000baf0 con 0x7fe94c08eeb0 2023-03-03T07:45:07.534 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:07.528+0000 7fe94a7fc700 1 -- 172.21.15.57:0/1211535580 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe94000bc50 con 0x7fe94c08eeb0 2023-03-03T07:45:07.534 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:07.528+0000 7fe94a7fc700 1 -- 172.21.15.57:0/1211535580 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe940004030 con 0x7fe94c08eeb0 2023-03-03T07:45:07.535 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:07.528+0000 7fe9521ba700 1 -- 172.21.15.57:0/1211535580 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe94c08eeb0 msgr2=0x7fe94c1242b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:45:07.535 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:07.528+0000 7fe9521ba700 1 --2- 172.21.15.57:0/1211535580 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe94c08eeb0 0x7fe94c1242b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe940009aa0 tx=0x7fe940009db0 comp rx=0 tx=0).stop 2023-03-03T07:45:07.535 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:07.528+0000 7fe9521ba700 1 -- 172.21.15.57:0/1211535580 shutdown_connections 2023-03-03T07:45:07.536 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:07.528+0000 7fe9521ba700 1 --2- 172.21.15.57:0/1211535580 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe94c08eeb0 0x7fe94c1242b0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:45:07.536 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:07.528+0000 7fe9521ba700 1 -- 172.21.15.57:0/1211535580 >> 172.21.15.57:0/1211535580 conn(0x7fe94c08a180 msgr2=0x7fe94c08c560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:45:07.536 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:07.528+0000 7fe9521ba700 1 -- 172.21.15.57:0/1211535580 shutdown_connections 2023-03-03T07:45:07.536 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:07.528+0000 7fe9521ba700 1 -- 172.21.15.57:0/1211535580 wait complete. 2023-03-03T07:45:07.537 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:07.532+0000 7fe9521ba700 1 Processor -- start 2023-03-03T07:45:07.538 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:07.532+0000 7fe9521ba700 1 -- start start 2023-03-03T07:45:07.538 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:07.532+0000 7fe9521ba700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe94c08eeb0 0x7fe94c11af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:45:07.538 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:07.532+0000 7fe9521ba700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe94c1244f0 con 0x7fe94c08eeb0 2023-03-03T07:45:07.539 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:07.532+0000 7fe94b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe94c08eeb0 0x7fe94c11af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:45:07.540 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:07.532+0000 7fe94b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe94c08eeb0 0x7fe94c11af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34502/0 (socket says 172.21.15.57:34502) 2023-03-03T07:45:07.540 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:07.532+0000 7fe94b7fe700 1 -- 172.21.15.57:0/425990499 learned_addr learned my addr 172.21.15.57:0/425990499 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:45:07.540 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:07.532+0000 7fe94b7fe700 1 -- 172.21.15.57:0/425990499 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe940009570 con 0x7fe94c08eeb0 2023-03-03T07:45:07.540 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:07.536+0000 7fe94b7fe700 1 --2- 172.21.15.57:0/425990499 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe94c08eeb0 0x7fe94c11af30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe93c00cbd0 tx=0x7fe93c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:45:07.541 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:07.536+0000 7fe933fff700 1 -- 172.21.15.57:0/425990499 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe93c00aa60 con 0x7fe94c08eeb0 2023-03-03T07:45:07.542 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:07.536+0000 7fe933fff700 1 -- 172.21.15.57:0/425990499 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe93c00abc0 con 0x7fe94c08eeb0 2023-03-03T07:45:07.542 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:07.536+0000 7fe9521ba700 1 -- 172.21.15.57:0/425990499 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe94c08e620 con 0x7fe94c08eeb0 2023-03-03T07:45:07.542 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:07.536+0000 7fe933fff700 1 -- 172.21.15.57:0/425990499 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe93c00ae60 con 0x7fe94c08eeb0 2023-03-03T07:45:07.543 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:07.536+0000 7fe9521ba700 1 -- 172.21.15.57:0/425990499 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe94c124a00 con 0x7fe94c08eeb0 2023-03-03T07:45:07.543 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:07.536+0000 7fe9521ba700 1 -- 172.21.15.57:0/425990499 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe94c08e7b0 con 0x7fe94c08eeb0 2023-03-03T07:45:07.544 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:07.540+0000 7fe933fff700 1 -- 172.21.15.57:0/425990499 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 42245+0+0 (secure 0 0 0) 0x7fe93c019030 con 0x7fe94c08eeb0 2023-03-03T07:45:07.545 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:07.540+0000 7fe933fff700 1 --2- 172.21.15.57:0/425990499 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fe938034800 0x7fe938036cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:45:07.545 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:07.540+0000 7fe933fff700 1 -- 172.21.15.57:0/425990499 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 2928+0+0 (secure 0 0 0) 0x7fe93c045ea0 con 0x7fe94c08eeb0 2023-03-03T07:45:07.545 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:07.540+0000 7fe94affd700 1 --2- 172.21.15.57:0/425990499 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fe938034800 0x7fe938036cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:45:07.547 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:07.540+0000 7fe94affd700 1 --2- 172.21.15.57:0/425990499 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fe938034800 0x7fe938036cb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe940009df0 tx=0x7fe940008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:45:07.551 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:07.548+0000 7fe933fff700 1 -- 172.21.15.57:0/425990499 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe93c01ab50 con 0x7fe94c08eeb0 2023-03-03T07:45:07.736 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:07.732+0000 7fe9521ba700 1 -- 172.21.15.57:0/425990499 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd set-backfillfull-ratio", "ratio": 0.18} v 0) v1 -- 0x7fe94c0619b0 con 0x7fe94c08eeb0 2023-03-03T07:45:08.337 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:08.332+0000 7fe933fff700 1 -- 172.21.15.57:0/425990499 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd set-backfillfull-ratio", "ratio": 0.18}]=0 osd set-backfillfull-ratio 0.18 v21) v1 ==== 120+0+0 (secure 0 0 0) 0x7fe93c017020 con 0x7fe94c08eeb0 2023-03-03T07:45:08.450 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:08.444+0000 7fe9521ba700 1 -- 172.21.15.57:0/425990499 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd set-backfillfull-ratio", "ratio": 0.18} v 0) v1 -- 0x7fe94c0008d0 con 0x7fe94c08eeb0 2023-03-03T07:45:09.347 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.344+0000 7fe933fff700 1 -- 172.21.15.57:0/425990499 <== mon.0 v2:172.21.15.57:3300/0 8 ==== mon_command_ack([{"prefix": "osd set-backfillfull-ratio", "ratio": 0.18}]=0 osd set-backfillfull-ratio 0.18 v22) v1 ==== 120+0+0 (secure 0 0 0) 0x7fe93c01ab50 con 0x7fe94c08eeb0 2023-03-03T07:45:09.353 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.348+0000 7fe9521ba700 1 -- 172.21.15.57:0/425990499 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fe938034800 msgr2=0x7fe938036cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:45:09.353 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.348+0000 7fe9521ba700 1 --2- 172.21.15.57:0/425990499 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fe938034800 0x7fe938036cb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe940009df0 tx=0x7fe940008030 comp rx=0 tx=0).stop 2023-03-03T07:45:09.354 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.348+0000 7fe9521ba700 1 -- 172.21.15.57:0/425990499 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe94c08eeb0 msgr2=0x7fe94c11af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:45:09.354 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.348+0000 7fe9521ba700 1 --2- 172.21.15.57:0/425990499 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe94c08eeb0 0x7fe94c11af30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe93c00cbd0 tx=0x7fe93c00cf90 comp rx=0 tx=0).stop 2023-03-03T07:45:09.354 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.348+0000 7fe9521ba700 1 -- 172.21.15.57:0/425990499 shutdown_connections 2023-03-03T07:45:09.354 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.348+0000 7fe9521ba700 1 --2- 172.21.15.57:0/425990499 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fe938034800 0x7fe938036cb0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:45:09.354 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.348+0000 7fe9521ba700 1 --2- 172.21.15.57:0/425990499 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe94c08eeb0 0x7fe94c11af30 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:45:09.354 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.348+0000 7fe9521ba700 1 -- 172.21.15.57:0/425990499 >> 172.21.15.57:0/425990499 conn(0x7fe94c08a180 msgr2=0x7fe94c06e460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:45:09.355 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.352+0000 7fe9521ba700 1 -- 172.21.15.57:0/425990499 shutdown_connections 2023-03-03T07:45:09.355 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.352+0000 7fe9521ba700 1 -- 172.21.15.57:0/425990499 wait complete. 2023-03-03T07:45:09.358 INFO:tasks.workunit.client.0.smithi057.stderr:osd set-backfillfull-ratio 0.18 2023-03-03T07:45:09.382 INFO:tasks.workunit.client.0.smithi057.stderr:+ timeout=30 2023-03-03T07:45:09.382 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 30 -gt 0 ']' 2023-03-03T07:45:09.384 INFO:tasks.workunit.client.0.smithi057.stderr:++ ceph health detail 2023-03-03T07:45:09.541 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.536+0000 7f3b4f26f700 1 Processor -- start 2023-03-03T07:45:09.541 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.536+0000 7f3b4f26f700 1 -- start start 2023-03-03T07:45:09.543 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.536+0000 7f3b4f26f700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3b48069da0 0x7f3b4808afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:45:09.543 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.540+0000 7f3b4f26f700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b48071ca0 con 0x7f3b4808b4f0 2023-03-03T07:45:09.543 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.540+0000 7f3b4f26f700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b4808d490 con 0x7f3b48069da0 2023-03-03T07:45:09.543 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.540+0000 7f3b4da6c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f3b4808b4f0 0x7f3b481290c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:38558/0 (socket says 172.21.15.57:38558) 2023-03-03T07:45:09.544 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.540+0000 7f3b4da6c700 1 -- 172.21.15.57:0/3081352523 learned_addr learned my addr 172.21.15.57:0/3081352523 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:45:09.544 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.540+0000 7f3b4e26d700 1 --2- 172.21.15.57:0/3081352523 >> v2:172.21.15.57:3300/0 conn(0x7f3b48069da0 0x7f3b4808afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:45:09.544 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.540+0000 7f3b4d26b700 1 -- 172.21.15.57:0/3081352523 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3609382142 0 0) 0x7f3b48071ca0 con 0x7f3b4808b4f0 2023-03-03T07:45:09.545 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.540+0000 7f3b4d26b700 1 -- 172.21.15.57:0/3081352523 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b340035d0 con 0x7f3b4808b4f0 2023-03-03T07:45:09.545 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.540+0000 7f3b4e26d700 1 -- 172.21.15.57:0/3081352523 >> v1:172.21.15.57:6789/0 conn(0x7f3b4808b4f0 legacy=0x7f3b481290c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:45:09.545 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.540+0000 7f3b4e26d700 1 -- 172.21.15.57:0/3081352523 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b4808c5c0 con 0x7f3b48069da0 2023-03-03T07:45:09.546 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.540+0000 7f3b4e26d700 1 --2- 172.21.15.57:0/3081352523 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b48069da0 0x7f3b4808afb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3b440097d0 tx=0x7f3b44009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3900bf57dc5d106 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:45:09.546 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.540+0000 7f3b4d26b700 1 -- 172.21.15.57:0/3081352523 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3b44004160 con 0x7f3b48069da0 2023-03-03T07:45:09.546 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.540+0000 7f3b4d26b700 1 -- 172.21.15.57:0/3081352523 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b440042c0 con 0x7f3b48069da0 2023-03-03T07:45:09.547 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.540+0000 7f3b4d26b700 1 -- 172.21.15.57:0/3081352523 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3b440045a0 con 0x7f3b48069da0 2023-03-03T07:45:09.547 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.544+0000 7f3b4f26f700 1 -- 172.21.15.57:0/3081352523 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b48069da0 msgr2=0x7f3b4808afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:45:09.548 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.544+0000 7f3b4f26f700 1 --2- 172.21.15.57:0/3081352523 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b48069da0 0x7f3b4808afb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3b440097d0 tx=0x7f3b44009ae0 comp rx=0 tx=0).stop 2023-03-03T07:45:09.549 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.544+0000 7f3b4f26f700 1 -- 172.21.15.57:0/3081352523 shutdown_connections 2023-03-03T07:45:09.549 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.544+0000 7f3b4f26f700 1 --2- 172.21.15.57:0/3081352523 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b48069da0 0x7f3b4808afb0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:45:09.549 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.544+0000 7f3b4f26f700 1 -- 172.21.15.57:0/3081352523 >> 172.21.15.57:0/3081352523 conn(0x7f3b480943e0 msgr2=0x7f3b48095e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:45:09.549 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.544+0000 7f3b4f26f700 1 -- 172.21.15.57:0/3081352523 shutdown_connections 2023-03-03T07:45:09.549 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.544+0000 7f3b4f26f700 1 -- 172.21.15.57:0/3081352523 wait complete. 2023-03-03T07:45:09.551 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.548+0000 7f3b4f26f700 1 Processor -- start 2023-03-03T07:45:09.551 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.548+0000 7f3b4f26f700 1 -- start start 2023-03-03T07:45:09.552 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.548+0000 7f3b4f26f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b48069da0 0x7f3b481bbc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:45:09.552 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.548+0000 7f3b4f26f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b481bb820 con 0x7f3b48069da0 2023-03-03T07:45:09.553 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.548+0000 7f3b4e26d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b48069da0 0x7f3b481bbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:45:09.553 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.548+0000 7f3b4e26d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b48069da0 0x7f3b481bbc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50562/0 (socket says 172.21.15.57:50562) 2023-03-03T07:45:09.553 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.548+0000 7f3b4e26d700 1 -- 172.21.15.57:0/3588611749 learned_addr learned my addr 172.21.15.57:0/3588611749 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:45:09.553 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.548+0000 7f3b4e26d700 1 -- 172.21.15.57:0/3588611749 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b440094b0 con 0x7f3b48069da0 2023-03-03T07:45:09.554 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.548+0000 7f3b4e26d700 1 --2- 172.21.15.57:0/3588611749 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b48069da0 0x7f3b481bbc90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3b440090b0 tx=0x7f3b44004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:45:09.554 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.548+0000 7f3b3effd700 1 -- 172.21.15.57:0/3588611749 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3b44003cc0 con 0x7f3b48069da0 2023-03-03T07:45:09.555 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.548+0000 7f3b3effd700 1 -- 172.21.15.57:0/3588611749 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b4401f070 con 0x7f3b48069da0 2023-03-03T07:45:09.555 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.548+0000 7f3b3effd700 1 -- 172.21.15.57:0/3588611749 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3b44011630 con 0x7f3b48069da0 2023-03-03T07:45:09.555 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.548+0000 7f3b4f26f700 1 -- 172.21.15.57:0/3588611749 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b4808bd40 con 0x7f3b48069da0 2023-03-03T07:45:09.555 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.552+0000 7f3b4f26f700 1 -- 172.21.15.57:0/3588611749 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b4808bbb0 con 0x7f3b48069da0 2023-03-03T07:45:09.556 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.552+0000 7f3b3effd700 1 -- 172.21.15.57:0/3588611749 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 42245+0+0 (secure 0 0 0) 0x7f3b4402a020 con 0x7f3b48069da0 2023-03-03T07:45:09.557 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.552+0000 7f3b4f26f700 1 -- 172.21.15.57:0/3588611749 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b4812a7e0 con 0x7f3b48069da0 2023-03-03T07:45:09.557 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.552+0000 7f3b3effd700 1 --2- 172.21.15.57:0/3588611749 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f3b2c0347f0 0x7f3b2c036ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:45:09.557 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.552+0000 7f3b3effd700 1 -- 172.21.15.57:0/3588611749 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 2928+0+0 (secure 0 0 0) 0x7f3b440478d0 con 0x7f3b48069da0 2023-03-03T07:45:09.558 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.552+0000 7f3b4da6c700 1 --2- 172.21.15.57:0/3588611749 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f3b2c0347f0 0x7f3b2c036ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:45:09.559 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.556+0000 7f3b4da6c700 1 --2- 172.21.15.57:0/3588611749 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f3b2c0347f0 0x7f3b2c036ca0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3b4808c480 tx=0x7f3b38007a20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:45:09.564 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.560+0000 7f3b3effd700 1 -- 172.21.15.57:0/3588611749 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f3b44010380 con 0x7f3b48069da0 2023-03-03T07:45:09.795 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.792+0000 7f3b4f26f700 1 -- 172.21.15.57:0/3588611749 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f3b480619b0 con 0x7f3b48069da0 2023-03-03T07:45:09.796 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.792+0000 7f3b3effd700 1 -- 172.21.15.57:0/3588611749 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f3b44023bc0 con 0x7f3b48069da0 2023-03-03T07:45:09.953 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.948+0000 7f3b4f26f700 1 -- 172.21.15.57:0/3588611749 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f3b480619b0 con 0x7f3b48069da0 2023-03-03T07:45:09.954 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.948+0000 7f3b3effd700 1 -- 172.21.15.57:0/3588611749 <== mon.0 v2:172.21.15.57:3300/0 8 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f3b44023da0 con 0x7f3b48069da0 2023-03-03T07:45:09.956 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.952+0000 7f3b4f26f700 1 -- 172.21.15.57:0/3588611749 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f3b2c0347f0 msgr2=0x7f3b2c036ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:45:09.956 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.952+0000 7f3b4f26f700 1 --2- 172.21.15.57:0/3588611749 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f3b2c0347f0 0x7f3b2c036ca0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3b4808c480 tx=0x7f3b38007a20 comp rx=0 tx=0).stop 2023-03-03T07:45:09.956 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.952+0000 7f3b4f26f700 1 -- 172.21.15.57:0/3588611749 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b48069da0 msgr2=0x7f3b481bbc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:45:09.957 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.952+0000 7f3b4f26f700 1 --2- 172.21.15.57:0/3588611749 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b48069da0 0x7f3b481bbc90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3b440090b0 tx=0x7f3b44004770 comp rx=0 tx=0).stop 2023-03-03T07:45:09.957 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.952+0000 7f3b4f26f700 1 -- 172.21.15.57:0/3588611749 shutdown_connections 2023-03-03T07:45:09.957 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.952+0000 7f3b4f26f700 1 --2- 172.21.15.57:0/3588611749 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f3b2c0347f0 0x7f3b2c036ca0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:45:09.957 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.952+0000 7f3b4f26f700 1 --2- 172.21.15.57:0/3588611749 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b48069da0 0x7f3b481bbc90 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:45:09.958 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.952+0000 7f3b4f26f700 1 -- 172.21.15.57:0/3588611749 >> 172.21.15.57:0/3588611749 conn(0x7f3b480943e0 msgr2=0x7f3b48090a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:45:09.958 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.952+0000 7f3b4f26f700 1 -- 172.21.15.57:0/3588611749 shutdown_connections 2023-03-03T07:45:09.958 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:09.952+0000 7f3b4f26f700 1 -- 172.21.15.57:0/3588611749 wait complete. 2023-03-03T07:45:09.983 INFO:tasks.workunit.client.0.smithi057.stdout:Wating for osd to be full: 30 2023-03-03T07:45:09.983 INFO:tasks.workunit.client.0.smithi057.stderr:+ health=HEALTH_OK 2023-03-03T07:45:09.983 INFO:tasks.workunit.client.0.smithi057.stderr:+ [[ HEALTH_OK = *\O\S\D\_\F\U\L\L* ]] 2023-03-03T07:45:09.984 INFO:tasks.workunit.client.0.smithi057.stderr:+ echo 'Wating for osd to be full: 30' 2023-03-03T07:45:09.984 INFO:tasks.workunit.client.0.smithi057.stderr:+ sleep 1 2023-03-03T07:45:10.352 INFO:tasks.ceph.mon.a.smithi057.stderr:2023-03-03T07:45:10.348+0000 7fcc0ddf9700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2023-03-03T07:45:10.990 INFO:tasks.workunit.client.0.smithi057.stderr:+ let timeout-=1 2023-03-03T07:45:10.991 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 29 -gt 0 ']' 2023-03-03T07:45:10.993 INFO:tasks.workunit.client.0.smithi057.stderr:++ ceph health detail 2023-03-03T07:45:11.163 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.160+0000 7fd8c26b8700 1 Processor -- start 2023-03-03T07:45:11.164 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.160+0000 7fd8c26b8700 1 -- start start 2023-03-03T07:45:11.165 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.160+0000 7fd8c26b8700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd8bc091de0 0x7fd8bc08ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:45:11.165 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.160+0000 7fd8c26b8700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8bc0911f0 con 0x7fd8bc091a10 2023-03-03T07:45:11.165 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.160+0000 7fd8c26b8700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8bc0662f0 con 0x7fd8bc091de0 2023-03-03T07:45:11.166 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.160+0000 7fd8c16b6700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fd8bc091a10 0x7fd8bc08e730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:38564/0 (socket says 172.21.15.57:38564) 2023-03-03T07:45:11.166 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.160+0000 7fd8c16b6700 1 -- 172.21.15.57:0/4157293691 learned_addr learned my addr 172.21.15.57:0/4157293691 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:45:11.167 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.160+0000 7fd8c0eb5700 1 --2- 172.21.15.57:0/4157293691 >> v2:172.21.15.57:3300/0 conn(0x7fd8bc091de0 0x7fd8bc08ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:45:11.168 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.160+0000 7fd8b3fff700 1 -- 172.21.15.57:0/4157293691 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1111106527 0 0) 0x7fd8bc0911f0 con 0x7fd8bc091a10 2023-03-03T07:45:11.168 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.164+0000 7fd8b3fff700 1 -- 172.21.15.57:0/4157293691 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8a80035d0 con 0x7fd8bc091a10 2023-03-03T07:45:11.168 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.164+0000 7fd8c0eb5700 1 -- 172.21.15.57:0/4157293691 >> v1:172.21.15.57:6789/0 conn(0x7fd8bc091a10 legacy=0x7fd8bc08e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:45:11.168 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.164+0000 7fd8c0eb5700 1 -- 172.21.15.57:0/4157293691 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8bc066700 con 0x7fd8bc091de0 2023-03-03T07:45:11.169 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.164+0000 7fd8c0eb5700 1 --2- 172.21.15.57:0/4157293691 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8bc091de0 0x7fd8bc08ee40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac0097d0 tx=0x7fd8ac009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1bdfdda59d5984b server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:45:11.169 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.164+0000 7fd8b3fff700 1 -- 172.21.15.57:0/4157293691 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd8ac004160 con 0x7fd8bc091de0 2023-03-03T07:45:11.170 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.164+0000 7fd8b3fff700 1 -- 172.21.15.57:0/4157293691 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8ac0042c0 con 0x7fd8bc091de0 2023-03-03T07:45:11.170 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.164+0000 7fd8b3fff700 1 -- 172.21.15.57:0/4157293691 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd8ac0045a0 con 0x7fd8bc091de0 2023-03-03T07:45:11.170 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.164+0000 7fd8c26b8700 1 -- 172.21.15.57:0/4157293691 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8bc091de0 msgr2=0x7fd8bc08ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:45:11.170 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.164+0000 7fd8c26b8700 1 --2- 172.21.15.57:0/4157293691 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8bc091de0 0x7fd8bc08ee40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac0097d0 tx=0x7fd8ac009ae0 comp rx=0 tx=0).stop 2023-03-03T07:45:11.171 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.164+0000 7fd8c26b8700 1 -- 172.21.15.57:0/4157293691 shutdown_connections 2023-03-03T07:45:11.171 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.164+0000 7fd8c26b8700 1 --2- 172.21.15.57:0/4157293691 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8bc091de0 0x7fd8bc08ee40 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:45:11.171 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.164+0000 7fd8c26b8700 1 -- 172.21.15.57:0/4157293691 >> 172.21.15.57:0/4157293691 conn(0x7fd8bc08a3c0 msgr2=0x7fd8bc08c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:45:11.172 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.168+0000 7fd8c26b8700 1 -- 172.21.15.57:0/4157293691 shutdown_connections 2023-03-03T07:45:11.172 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.168+0000 7fd8c26b8700 1 -- 172.21.15.57:0/4157293691 wait complete. 2023-03-03T07:45:11.174 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.168+0000 7fd8c26b8700 1 Processor -- start 2023-03-03T07:45:11.175 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.172+0000 7fd8c26b8700 1 -- start start 2023-03-03T07:45:11.175 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.172+0000 7fd8c26b8700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8bc091a10 0x7fd8bc1bbc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:45:11.176 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.172+0000 7fd8c26b8700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8bc11d730 con 0x7fd8bc091a10 2023-03-03T07:45:11.176 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.172+0000 7fd8c16b6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8bc091a10 0x7fd8bc1bbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:45:11.176 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.172+0000 7fd8c16b6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8bc091a10 0x7fd8bc1bbc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50576/0 (socket says 172.21.15.57:50576) 2023-03-03T07:45:11.177 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.172+0000 7fd8c16b6700 1 -- 172.21.15.57:0/3394351183 learned_addr learned my addr 172.21.15.57:0/3394351183 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:45:11.177 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.172+0000 7fd8c16b6700 1 -- 172.21.15.57:0/3394351183 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8ac0094b0 con 0x7fd8bc091a10 2023-03-03T07:45:11.178 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.172+0000 7fd8c16b6700 1 --2- 172.21.15.57:0/3394351183 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8bc091a10 0x7fd8bc1bbc90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd8b800cb40 tx=0x7fd8b800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:45:11.178 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.172+0000 7fd8b1ffb700 1 -- 172.21.15.57:0/3394351183 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd8b800a760 con 0x7fd8bc091a10 2023-03-03T07:45:11.179 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.172+0000 7fd8c26b8700 1 -- 172.21.15.57:0/3394351183 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8bc090f00 con 0x7fd8bc091a10 2023-03-03T07:45:11.179 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.172+0000 7fd8b1ffb700 1 -- 172.21.15.57:0/3394351183 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b800a8c0 con 0x7fd8bc091a10 2023-03-03T07:45:11.179 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.172+0000 7fd8b1ffb700 1 -- 172.21.15.57:0/3394351183 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd8b800ab60 con 0x7fd8bc091a10 2023-03-03T07:45:11.179 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.172+0000 7fd8c26b8700 1 -- 172.21.15.57:0/3394351183 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8bc08f590 con 0x7fd8bc091a10 2023-03-03T07:45:11.180 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.176+0000 7fd8c26b8700 1 -- 172.21.15.57:0/3394351183 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8bc12d720 con 0x7fd8bc091a10 2023-03-03T07:45:11.181 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.176+0000 7fd8b1ffb700 1 -- 172.21.15.57:0/3394351183 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 42245+0+0 (secure 0 0 0) 0x7fd8b8019030 con 0x7fd8bc091a10 2023-03-03T07:45:11.182 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.176+0000 7fd8b1ffb700 1 --2- 172.21.15.57:0/3394351183 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fd8a00347b0 0x7fd8a0036c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:45:11.182 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.176+0000 7fd8b1ffb700 1 -- 172.21.15.57:0/3394351183 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 2928+0+0 (secure 0 0 0) 0x7fd8b8045b90 con 0x7fd8bc091a10 2023-03-03T07:45:11.183 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.180+0000 7fd8b1ffb700 1 -- 172.21.15.57:0/3394351183 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=24}) v3 -- 0x7fd8a003b050 con 0x7fd8bc091a10 2023-03-03T07:45:11.183 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.180+0000 7fd8c0eb5700 1 --2- 172.21.15.57:0/3394351183 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fd8a00347b0 0x7fd8a0036c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:45:11.184 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.180+0000 7fd8c0eb5700 1 --2- 172.21.15.57:0/3394351183 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fd8a00347b0 0x7fd8a0036c60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac0097d0 tx=0x7fd8ac008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:45:11.189 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.184+0000 7fd8b1ffb700 1 -- 172.21.15.57:0/3394351183 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd8b8017020 con 0x7fd8bc091a10 2023-03-03T07:45:11.432 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.428+0000 7fd8c26b8700 1 -- 172.21.15.57:0/3394351183 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fd8bc0619b0 con 0x7fd8bc091a10 2023-03-03T07:45:11.432 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.428+0000 7fd8b1ffb700 1 -- 172.21.15.57:0/3394351183 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+278 (secure 0 0 0) 0x7fd8b8017020 con 0x7fd8bc091a10 2023-03-03T07:45:11.592 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.588+0000 7fd8c26b8700 1 -- 172.21.15.57:0/3394351183 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fd8bc0619b0 con 0x7fd8bc091a10 2023-03-03T07:45:11.593 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.588+0000 7fd8b1ffb700 1 -- 172.21.15.57:0/3394351183 <== mon.0 v2:172.21.15.57:3300/0 8 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+278 (secure 0 0 0) 0x7fd8b8017030 con 0x7fd8bc091a10 2023-03-03T07:45:11.597 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.592+0000 7fd8c26b8700 1 -- 172.21.15.57:0/3394351183 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fd8a00347b0 msgr2=0x7fd8a0036c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:45:11.597 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.592+0000 7fd8c26b8700 1 --2- 172.21.15.57:0/3394351183 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fd8a00347b0 0x7fd8a0036c60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac0097d0 tx=0x7fd8ac008030 comp rx=0 tx=0).stop 2023-03-03T07:45:11.598 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.592+0000 7fd8c26b8700 1 -- 172.21.15.57:0/3394351183 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8bc091a10 msgr2=0x7fd8bc1bbc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:45:11.598 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.592+0000 7fd8c26b8700 1 --2- 172.21.15.57:0/3394351183 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8bc091a10 0x7fd8bc1bbc90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd8b800cb40 tx=0x7fd8b800cc20 comp rx=0 tx=0).stop 2023-03-03T07:45:11.598 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.592+0000 7fd8c26b8700 1 -- 172.21.15.57:0/3394351183 shutdown_connections 2023-03-03T07:45:11.598 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.592+0000 7fd8c26b8700 1 --2- 172.21.15.57:0/3394351183 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fd8a00347b0 0x7fd8a0036c60 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:45:11.599 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.592+0000 7fd8c26b8700 1 --2- 172.21.15.57:0/3394351183 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8bc091a10 0x7fd8bc1bbc90 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:45:11.599 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.592+0000 7fd8c26b8700 1 -- 172.21.15.57:0/3394351183 >> 172.21.15.57:0/3394351183 conn(0x7fd8bc08a3c0 msgr2=0x7fd8bc12c730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:45:11.599 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.592+0000 7fd8c26b8700 1 -- 172.21.15.57:0/3394351183 shutdown_connections 2023-03-03T07:45:11.599 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.592+0000 7fd8c26b8700 1 -- 172.21.15.57:0/3394351183 wait complete. 2023-03-03T07:45:11.624 INFO:tasks.workunit.client.0.smithi057.stderr:+ health='HEALTH_ERR 1 full osd(s); 4 pool(s) full 2023-03-03T07:45:11.624 INFO:tasks.workunit.client.0.smithi057.stderr:[ERR] OSD_FULL: 1 full osd(s) 2023-03-03T07:45:11.624 INFO:tasks.workunit.client.0.smithi057.stderr: osd.0 is full 2023-03-03T07:45:11.624 INFO:tasks.workunit.client.0.smithi057.stderr:[WRN] POOL_FULL: 4 pool(s) full 2023-03-03T07:45:11.625 INFO:tasks.workunit.client.0.smithi057.stderr: pool '\''.mgr'\'' is full (no space) 2023-03-03T07:45:11.625 INFO:tasks.workunit.client.0.smithi057.stderr: pool '\''rbd'\'' is full (no space) 2023-03-03T07:45:11.626 INFO:tasks.workunit.client.0.smithi057.stderr: pool '\''cephfs_metadata'\'' is full (no space) 2023-03-03T07:45:11.627 INFO:tasks.workunit.client.0.smithi057.stderr: pool '\''cephfs_data'\'' is full (no space)' 2023-03-03T07:45:11.627 INFO:tasks.workunit.client.0.smithi057.stderr:+ [[ HEALTH_ERR 1 full osd(s); 4 pool(s) full 2023-03-03T07:45:11.627 INFO:tasks.workunit.client.0.smithi057.stderr:[ERR] OSD_FULL: 1 full osd(s) 2023-03-03T07:45:11.628 INFO:tasks.workunit.client.0.smithi057.stderr: osd.0 is full 2023-03-03T07:45:11.628 INFO:tasks.workunit.client.0.smithi057.stderr:[WRN] POOL_FULL: 4 pool(s) full 2023-03-03T07:45:11.628 INFO:tasks.workunit.client.0.smithi057.stderr: pool '.mgr' is full (no space) 2023-03-03T07:45:11.628 INFO:tasks.workunit.client.0.smithi057.stderr: pool 'rbd' is full (no space) 2023-03-03T07:45:11.628 INFO:tasks.workunit.client.0.smithi057.stderr: pool 'cephfs_metadata' is full (no space) 2023-03-03T07:45:11.628 INFO:tasks.workunit.client.0.smithi057.stderr: pool 'cephfs_data' is full (no space) = *\O\S\D\_\F\U\L\L* ]] 2023-03-03T07:45:11.629 INFO:tasks.workunit.client.0.smithi057.stdout:OSD is full 2023-03-03T07:45:11.630 INFO:tasks.workunit.client.0.smithi057.stderr:+ echo 'OSD is full' 2023-03-03T07:45:11.630 INFO:tasks.workunit.client.0.smithi057.stderr:+ break 2023-03-03T07:45:11.630 INFO:tasks.workunit.client.0.smithi057.stdout:After ratio set 2023-03-03T07:45:11.631 INFO:tasks.workunit.client.0.smithi057.stderr:+ echo 'After ratio set' 2023-03-03T07:45:11.631 INFO:tasks.workunit.client.0.smithi057.stderr:+ df -h 2023-03-03T07:45:11.634 INFO:tasks.workunit.client.0.smithi057.stdout:Filesystem Size Used Avail Use% Mounted on 2023-03-03T07:45:11.634 INFO:tasks.workunit.client.0.smithi057.stdout:udev 16G 0 16G 0% /dev 2023-03-03T07:45:11.635 INFO:tasks.workunit.client.0.smithi057.stdout:tmpfs 3.2G 1.9M 3.2G 1% /run 2023-03-03T07:45:11.635 INFO:tasks.workunit.client.0.smithi057.stdout:/dev/sda1 916G 17G 854G 2% / 2023-03-03T07:45:11.635 INFO:tasks.workunit.client.0.smithi057.stdout:tmpfs 16G 20K 16G 1% /dev/shm 2023-03-03T07:45:11.635 INFO:tasks.workunit.client.0.smithi057.stdout:tmpfs 5.0M 0 5.0M 0% /run/lock 2023-03-03T07:45:11.636 INFO:tasks.workunit.client.0.smithi057.stdout:tmpfs 16G 0 16G 0% /sys/fs/cgroup 2023-03-03T07:45:11.636 INFO:tasks.workunit.client.0.smithi057.stdout:tmpfs 3.2G 0 3.2G 0% /run/user/1000 2023-03-03T07:45:11.636 INFO:tasks.workunit.client.0.smithi057.stdout:/dev/mapper/vg_nvme-lv_5 15G 72M 15G 1% /var/lib/ceph 2023-03-03T07:45:11.636 INFO:tasks.workunit.client.0.smithi057.stdout:ceph-fuse 500M 500M 0 100% /home/ubuntu/cephtest/mnt.0 2023-03-03T07:45:11.637 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph osd df 2023-03-03T07:45:11.801 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.796+0000 7f07458fa700 1 Processor -- start 2023-03-03T07:45:11.802 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.796+0000 7f07458fa700 1 -- start start 2023-03-03T07:45:11.802 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.796+0000 7f07458fa700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f074006b560 0x7f0740123a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:45:11.803 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.796+0000 7f07458fa700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f074006d370 con 0x7f074006c4b0 2023-03-03T07:45:11.803 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.796+0000 7f07458fa700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f074006b210 con 0x7f074006b560 2023-03-03T07:45:11.803 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.800+0000 7f073effd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f074006b560 0x7f0740123a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:45:11.804 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.800+0000 7f073effd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f074006b560 0x7f0740123a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50586/0 (socket says 172.21.15.57:50586) 2023-03-03T07:45:11.804 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.800+0000 7f073effd700 1 -- 172.21.15.57:0/426129072 learned_addr learned my addr 172.21.15.57:0/426129072 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:45:11.804 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.800+0000 7f073effd700 1 -- 172.21.15.57:0/426129072 >> v1:172.21.15.57:6789/0 conn(0x7f074006c4b0 legacy=0x7f0740123f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T07:45:11.804 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.800+0000 7f073effd700 1 -- 172.21.15.57:0/426129072 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0740124650 con 0x7f074006b560 2023-03-03T07:45:11.805 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.800+0000 7f073effd700 1 --2- 172.21.15.57:0/426129072 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f074006b560 0x7f0740123a00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f073000bb30 tx=0x7f073000be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40711b2c019aa76b server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:45:11.805 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.800+0000 7f073dffb700 1 -- 172.21.15.57:0/426129072 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f073000dc60 con 0x7f074006b560 2023-03-03T07:45:11.806 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.800+0000 7f073dffb700 1 -- 172.21.15.57:0/426129072 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f073000ddc0 con 0x7f074006b560 2023-03-03T07:45:11.806 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.800+0000 7f073dffb700 1 -- 172.21.15.57:0/426129072 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0730004180 con 0x7f074006b560 2023-03-03T07:45:11.806 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.800+0000 7f07458fa700 1 -- 172.21.15.57:0/426129072 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f074006b560 msgr2=0x7f0740123a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:45:11.806 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.800+0000 7f07458fa700 1 --2- 172.21.15.57:0/426129072 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f074006b560 0x7f0740123a00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f073000bb30 tx=0x7f073000be40 comp rx=0 tx=0).stop 2023-03-03T07:45:11.807 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.800+0000 7f07458fa700 1 -- 172.21.15.57:0/426129072 shutdown_connections 2023-03-03T07:45:11.807 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.800+0000 7f07458fa700 1 --2- 172.21.15.57:0/426129072 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f074006b560 0x7f0740123a00 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:45:11.807 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.800+0000 7f07458fa700 1 -- 172.21.15.57:0/426129072 >> 172.21.15.57:0/426129072 conn(0x7f0740069f80 msgr2=0x7f074006a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:45:11.807 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.804+0000 7f07458fa700 1 -- 172.21.15.57:0/426129072 shutdown_connections 2023-03-03T07:45:11.807 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.804+0000 7f07458fa700 1 -- 172.21.15.57:0/426129072 wait complete. 2023-03-03T07:45:11.810 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.804+0000 7f07458fa700 1 Processor -- start 2023-03-03T07:45:11.810 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.804+0000 7f07458fa700 1 -- start start 2023-03-03T07:45:11.812 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.808+0000 7f07458fa700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f074006b560 0x7f07401bc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:45:11.812 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.808+0000 7f07458fa700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07401b9a70 con 0x7f074006b560 2023-03-03T07:45:11.812 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.808+0000 7f073effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f074006b560 0x7f07401bc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:45:11.813 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.808+0000 7f073effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f074006b560 0x7f07401bc0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50590/0 (socket says 172.21.15.57:50590) 2023-03-03T07:45:11.813 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.808+0000 7f073effd700 1 -- 172.21.15.57:0/2735567603 learned_addr learned my addr 172.21.15.57:0/2735567603 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:45:11.813 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.808+0000 7f073effd700 1 -- 172.21.15.57:0/2735567603 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f073000b810 con 0x7f074006b560 2023-03-03T07:45:11.813 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.808+0000 7f073effd700 1 --2- 172.21.15.57:0/2735567603 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f074006b560 0x7f07401bc0b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f073000e010 tx=0x7f0730004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:45:11.814 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.808+0000 7f0727fff700 1 -- 172.21.15.57:0/2735567603 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0730003dd0 con 0x7f074006b560 2023-03-03T07:45:11.814 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.808+0000 7f07458fa700 1 -- 172.21.15.57:0/2735567603 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f074006c000 con 0x7f074006b560 2023-03-03T07:45:11.814 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.808+0000 7f0727fff700 1 -- 172.21.15.57:0/2735567603 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0730010470 con 0x7f074006b560 2023-03-03T07:45:11.814 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.808+0000 7f0727fff700 1 -- 172.21.15.57:0/2735567603 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0730010710 con 0x7f074006b560 2023-03-03T07:45:11.815 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.808+0000 7f07458fa700 1 -- 172.21.15.57:0/2735567603 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f074006be70 con 0x7f074006b560 2023-03-03T07:45:11.816 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.812+0000 7f07458fa700 1 -- 172.21.15.57:0/2735567603 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f074006c190 con 0x7f074006b560 2023-03-03T07:45:11.816 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.812+0000 7f0727fff700 1 -- 172.21.15.57:0/2735567603 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 42245+0+0 (secure 0 0 0) 0x7f0730029020 con 0x7f074006b560 2023-03-03T07:45:11.817 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.812+0000 7f0727fff700 1 --2- 172.21.15.57:0/2735567603 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f072c0347b0 0x7f072c036c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:45:11.817 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.812+0000 7f0727fff700 1 -- 172.21.15.57:0/2735567603 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 2928+0+0 (secure 0 0 0) 0x7f0730048270 con 0x7f074006b560 2023-03-03T07:45:11.818 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.812+0000 7f0727fff700 1 -- 172.21.15.57:0/2735567603 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=24}) v3 -- 0x7f072c03b050 con 0x7f074006b560 2023-03-03T07:45:11.819 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.812+0000 7f073e7fc700 1 --2- 172.21.15.57:0/2735567603 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f072c0347b0 0x7f072c036c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:45:11.819 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.816+0000 7f073e7fc700 1 --2- 172.21.15.57:0/2735567603 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f072c0347b0 0x7f072c036c60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0734000f60 tx=0x7f0734007ae0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:45:11.826 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:11.820+0000 7f0727fff700 1 -- 172.21.15.57:0/2735567603 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f0730021390 con 0x7f074006b560 2023-03-03T07:45:12.004 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.000+0000 7f07458fa700 1 -- 172.21.15.57:0/2735567603 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 0: {"prefix": "osd df", "target": ["mon-mgr", ""]}) v1 -- 0x7f07400619b0 con 0x7f072c0347b0 2023-03-03T07:45:12.005 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.000+0000 7f0727fff700 1 -- 172.21.15.57:0/2735567603 <== mgr.4099 v2:172.21.15.57:6808/28565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+343 (secure 0 0 0) 0x7f07400619b0 con 0x7f072c0347b0 2023-03-03T07:45:12.105 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.100+0000 7f07458fa700 1 -- 172.21.15.57:0/2735567603 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 1: {"prefix": "osd df", "target": ["mon-mgr", ""]}) v1 -- 0x7f07400008d0 con 0x7f072c0347b0 2023-03-03T07:45:12.106 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.100+0000 7f0727fff700 1 -- 172.21.15.57:0/2735567603 <== mgr.4099 v2:172.21.15.57:6808/28565 2 ==== mgr_command_reply(tid 1: 0 ) v1 ==== 8+0+343 (secure 0 0 0) 0x7f07400008d0 con 0x7f072c0347b0 2023-03-03T07:45:12.106 INFO:tasks.workunit.client.0.smithi057.stdout:ID CLASS WEIGHT REWEIGHT SIZE RAW USE DATA OMAP META AVAIL %USE VAR PGS STATUS 2023-03-03T07:45:12.106 INFO:tasks.workunit.client.0.smithi057.stdout: 0 ssd 0.00099 1.00000 1 GiB 514 MiB 501 MiB 0 B 13 MiB 510 MiB 50.22 1.00 105 up 2023-03-03T07:45:12.106 INFO:tasks.workunit.client.0.smithi057.stdout: TOTAL 1 GiB 514 MiB 501 MiB 0 B 13 MiB 510 MiB 50.22 2023-03-03T07:45:12.106 INFO:tasks.workunit.client.0.smithi057.stdout:MIN/MAX VAR: 1.00/1.00 STDDEV: 0 2023-03-03T07:45:12.108 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.104+0000 7f07458fa700 1 -- 172.21.15.57:0/2735567603 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f072c0347b0 msgr2=0x7f072c036c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:45:12.109 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.104+0000 7f07458fa700 1 --2- 172.21.15.57:0/2735567603 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f072c0347b0 0x7f072c036c60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0734000f60 tx=0x7f0734007ae0 comp rx=0 tx=0).stop 2023-03-03T07:45:12.109 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.104+0000 7f07458fa700 1 -- 172.21.15.57:0/2735567603 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f074006b560 msgr2=0x7f07401bc0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:45:12.109 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.104+0000 7f07458fa700 1 --2- 172.21.15.57:0/2735567603 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f074006b560 0x7f07401bc0b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f073000e010 tx=0x7f0730004770 comp rx=0 tx=0).stop 2023-03-03T07:45:12.109 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.104+0000 7f07458fa700 1 -- 172.21.15.57:0/2735567603 shutdown_connections 2023-03-03T07:45:12.110 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.104+0000 7f07458fa700 1 --2- 172.21.15.57:0/2735567603 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f072c0347b0 0x7f072c036c60 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:45:12.110 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.104+0000 7f07458fa700 1 --2- 172.21.15.57:0/2735567603 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f074006b560 0x7f07401bc0b0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:45:12.110 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.104+0000 7f07458fa700 1 -- 172.21.15.57:0/2735567603 >> 172.21.15.57:0/2735567603 conn(0x7f0740069f80 msgr2=0x7f07400951d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:45:12.110 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.104+0000 7f07458fa700 1 -- 172.21.15.57:0/2735567603 shutdown_connections 2023-03-03T07:45:12.110 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.104+0000 7f07458fa700 1 -- 172.21.15.57:0/2735567603 wait complete. 2023-03-03T07:45:12.137 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph fs subvolume rm cephfs sub_0 2023-03-03T07:45:12.308 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.304+0000 7fe3b3445700 1 Processor -- start 2023-03-03T07:45:12.309 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.304+0000 7fe3b3445700 1 -- start start 2023-03-03T07:45:12.311 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.308+0000 7fe3b3445700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe3ac12ab20 0x7fe3ac12cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:45:12.312 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.308+0000 7fe3b3445700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3ac08f8e0 con 0x7fe3ac08e4c0 2023-03-03T07:45:12.312 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.308+0000 7fe3b3445700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3ac08f760 con 0x7fe3ac12ab20 2023-03-03T07:45:12.313 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.308+0000 7fe3b1c42700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe3ac12ab20 0x7fe3ac12cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:45:12.313 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.308+0000 7fe3b1c42700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe3ac12ab20 0x7fe3ac12cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50600/0 (socket says 172.21.15.57:50600) 2023-03-03T07:45:12.313 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.308+0000 7fe3b1c42700 1 -- 172.21.15.57:0/747208935 learned_addr learned my addr 172.21.15.57:0/747208935 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:45:12.313 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.308+0000 7fe3b1c42700 1 -- 172.21.15.57:0/747208935 >> v1:172.21.15.57:6789/0 conn(0x7fe3ac08e4c0 legacy=0x7fe3ac08e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T07:45:12.313 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.308+0000 7fe3b1c42700 1 -- 172.21.15.57:0/747208935 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3ac090650 con 0x7fe3ac12ab20 2023-03-03T07:45:12.314 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.308+0000 7fe3b1c42700 1 --2- 172.21.15.57:0/747208935 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3ac12ab20 0x7fe3ac12cf00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe39c009890 tx=0x7fe39c009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85d93125d4f0ba2d server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:45:12.314 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.308+0000 7fe3b1441700 1 -- 172.21.15.57:0/747208935 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe39c004160 con 0x7fe3ac12ab20 2023-03-03T07:45:12.314 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.308+0000 7fe3b1441700 1 -- 172.21.15.57:0/747208935 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe39c0042c0 con 0x7fe3ac12ab20 2023-03-03T07:45:12.315 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.308+0000 7fe3b1441700 1 -- 172.21.15.57:0/747208935 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe39c004560 con 0x7fe3ac12ab20 2023-03-03T07:45:12.315 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.308+0000 7fe3b3445700 1 -- 172.21.15.57:0/747208935 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3ac12ab20 msgr2=0x7fe3ac12cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:45:12.315 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.308+0000 7fe3b3445700 1 --2- 172.21.15.57:0/747208935 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3ac12ab20 0x7fe3ac12cf00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe39c009890 tx=0x7fe39c009ba0 comp rx=0 tx=0).stop 2023-03-03T07:45:12.315 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.312+0000 7fe3b3445700 1 -- 172.21.15.57:0/747208935 shutdown_connections 2023-03-03T07:45:12.316 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.312+0000 7fe3b3445700 1 --2- 172.21.15.57:0/747208935 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3ac12ab20 0x7fe3ac12cf00 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:45:12.316 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.312+0000 7fe3b3445700 1 -- 172.21.15.57:0/747208935 >> 172.21.15.57:0/747208935 conn(0x7fe3ac089fa0 msgr2=0x7fe3ac08c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:45:12.316 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.312+0000 7fe3b3445700 1 -- 172.21.15.57:0/747208935 shutdown_connections 2023-03-03T07:45:12.316 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.312+0000 7fe3b3445700 1 -- 172.21.15.57:0/747208935 wait complete. 2023-03-03T07:45:12.317 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.312+0000 7fe3b3445700 1 Processor -- start 2023-03-03T07:45:12.318 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.312+0000 7fe3b3445700 1 -- start start 2023-03-03T07:45:12.318 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.312+0000 7fe3b3445700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3ac08e4c0 0x7fe3ac1177c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:45:12.318 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.312+0000 7fe3b3445700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3ac11a2d0 con 0x7fe3ac08e4c0 2023-03-03T07:45:12.319 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.316+0000 7fe3b2443700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3ac08e4c0 0x7fe3ac1177c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:45:12.319 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.316+0000 7fe3b2443700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3ac08e4c0 0x7fe3ac1177c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50610/0 (socket says 172.21.15.57:50610) 2023-03-03T07:45:12.319 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.316+0000 7fe3b2443700 1 -- 172.21.15.57:0/3792507876 learned_addr learned my addr 172.21.15.57:0/3792507876 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:45:12.320 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.316+0000 7fe3b2443700 1 -- 172.21.15.57:0/3792507876 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe39c009570 con 0x7fe3ac08e4c0 2023-03-03T07:45:12.320 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.316+0000 7fe3b2443700 1 --2- 172.21.15.57:0/3792507876 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3ac08e4c0 0x7fe3ac1177c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe3a800c480 tx=0x7fe3a800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:45:12.321 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.316+0000 7fe3a2ffd700 1 -- 172.21.15.57:0/3792507876 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3a8005150 con 0x7fe3ac08e4c0 2023-03-03T07:45:12.321 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.316+0000 7fe3a2ffd700 1 -- 172.21.15.57:0/3792507876 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a80052b0 con 0x7fe3ac08e4c0 2023-03-03T07:45:12.321 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.316+0000 7fe3b3445700 1 -- 172.21.15.57:0/3792507876 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3ac12d5d0 con 0x7fe3ac08e4c0 2023-03-03T07:45:12.321 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.316+0000 7fe3a2ffd700 1 -- 172.21.15.57:0/3792507876 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3a8005590 con 0x7fe3ac08e4c0 2023-03-03T07:45:12.322 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.316+0000 7fe3b3445700 1 -- 172.21.15.57:0/3792507876 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3ac12d440 con 0x7fe3ac08e4c0 2023-03-03T07:45:12.323 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.320+0000 7fe3a2ffd700 1 -- 172.21.15.57:0/3792507876 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 42245+0+0 (secure 0 0 0) 0x7fe3a8010050 con 0x7fe3ac08e4c0 2023-03-03T07:45:12.324 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.320+0000 7fe3b3445700 1 -- 172.21.15.57:0/3792507876 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3ac12d760 con 0x7fe3ac08e4c0 2023-03-03T07:45:12.324 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.320+0000 7fe3a2ffd700 1 --2- 172.21.15.57:0/3792507876 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fe390034800 0x7fe390036cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:45:12.325 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.320+0000 7fe3a2ffd700 1 -- 172.21.15.57:0/3792507876 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 2928+0+0 (secure 0 0 0) 0x7fe3a8045370 con 0x7fe3ac08e4c0 2023-03-03T07:45:12.325 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.320+0000 7fe3b1c42700 1 --2- 172.21.15.57:0/3792507876 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fe390034800 0x7fe390036cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:45:12.325 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.320+0000 7fe3a2ffd700 1 -- 172.21.15.57:0/3792507876 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=24}) v3 -- 0x7fe39003b0a0 con 0x7fe3ac08e4c0 2023-03-03T07:45:12.326 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.320+0000 7fe3b1c42700 1 --2- 172.21.15.57:0/3792507876 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fe390034800 0x7fe390036cb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac092370 tx=0x7fe39c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:45:12.332 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.328+0000 7fe3a2ffd700 1 -- 172.21.15.57:0/3792507876 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe3a8007030 con 0x7fe3ac08e4c0 2023-03-03T07:45:12.536 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.532+0000 7fe3b3445700 1 -- 172.21.15.57:0/3792507876 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "sub_0", "target": ["mon-mgr", ""]}) v1 -- 0x7fe3ac061a20 con 0x7fe390034800 2023-03-03T07:45:12.563 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.560+0000 7fe3a2ffd700 1 -- 172.21.15.57:0/3792507876 <== mgr.4099 v2:172.21.15.57:6808/28565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fe3ac061a20 con 0x7fe390034800 2023-03-03T07:45:12.571 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:45:12.568+0000 7fde492d2700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-03T07:45:12.572 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:45:12.568+0000 7fde492d2700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-03T07:45:12.572 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:45:12.568+0000 7fde492d2700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-03T07:45:12.572 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:45:12.568+0000 7fde492d2700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-03T07:45:12.572 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:45:12.568+0000 7fde492d2700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-03T07:45:12.606 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:45:12.600+0000 7fde47acf700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-03T07:45:12.606 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:45:12.600+0000 7fde47acf700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-03T07:45:12.606 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:45:12.600+0000 7fde47acf700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-03T07:45:12.607 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:45:12.600+0000 7fde47acf700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-03T07:45:12.607 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:45:12.600+0000 7fde47acf700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-03T07:45:12.706 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.700+0000 7fe3b3445700 1 -- 172.21.15.57:0/3792507876 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 1: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "sub_0", "target": ["mon-mgr", ""]}) v1 -- 0x7fe3ac123420 con 0x7fe390034800 2023-03-03T07:45:12.713 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:45:12.708+0000 7fde62304700 -1 mgr.server reply reply (2) No such file or directory subvolume 'sub_0' does not exist 2023-03-03T07:45:12.714 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.708+0000 7fe3a2ffd700 1 -- 172.21.15.57:0/3792507876 <== mgr.4099 v2:172.21.15.57:6808/28565 2 ==== mgr_command_reply(tid 1: -2 subvolume 'sub_0' does not exist) v1 ==== 40+0+0 (secure 0 0 0) 0x7fe3ac123420 con 0x7fe390034800 2023-03-03T07:45:12.717 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.712+0000 7fe3b3445700 1 -- 172.21.15.57:0/3792507876 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fe390034800 msgr2=0x7fe390036cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:45:12.718 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.712+0000 7fe3b3445700 1 --2- 172.21.15.57:0/3792507876 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fe390034800 0x7fe390036cb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac092370 tx=0x7fe39c008030 comp rx=0 tx=0).stop 2023-03-03T07:45:12.718 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.712+0000 7fe3b3445700 1 -- 172.21.15.57:0/3792507876 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3ac08e4c0 msgr2=0x7fe3ac1177c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:45:12.718 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.712+0000 7fe3b3445700 1 --2- 172.21.15.57:0/3792507876 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3ac08e4c0 0x7fe3ac1177c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe3a800c480 tx=0x7fe3a800c840 comp rx=0 tx=0).stop 2023-03-03T07:45:12.718 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.712+0000 7fe3b3445700 1 -- 172.21.15.57:0/3792507876 shutdown_connections 2023-03-03T07:45:12.718 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.712+0000 7fe3b3445700 1 --2- 172.21.15.57:0/3792507876 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fe390034800 0x7fe390036cb0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:45:12.718 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.712+0000 7fe3b3445700 1 --2- 172.21.15.57:0/3792507876 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3ac08e4c0 0x7fe3ac1177c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:45:12.719 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.712+0000 7fe3b3445700 1 -- 172.21.15.57:0/3792507876 >> 172.21.15.57:0/3792507876 conn(0x7fe3ac089fa0 msgr2=0x7fe3ac12c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:45:12.719 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.712+0000 7fe3b3445700 1 -- 172.21.15.57:0/3792507876 shutdown_connections 2023-03-03T07:45:12.719 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.712+0000 7fe3b3445700 1 -- 172.21.15.57:0/3792507876 wait complete. 2023-03-03T07:45:12.720 INFO:tasks.workunit.client.0.smithi057.stderr:Second attempt of previously successful command failed with ENOENT: subvolume 'sub_0' does not exist 2023-03-03T07:45:12.720 INFO:tasks.workunit.client.0.smithi057.stderr:subvolume 'sub_0' does not exist 2023-03-03T07:45:12.743 INFO:tasks.workunit.client.0.smithi057.stderr:+ expect_failure ceph fs subvolume info cephfs sub_0 2023-03-03T07:45:12.743 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph fs subvolume info cephfs sub_0 2023-03-03T07:45:12.905 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.900+0000 7fb92cfc3700 1 Processor -- start 2023-03-03T07:45:12.906 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.900+0000 7fb92cfc3700 1 -- start start 2023-03-03T07:45:12.907 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.904+0000 7fb92cfc3700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb92812ab20 0x7fb92812cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:45:12.907 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.904+0000 7fb92cfc3700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb92808f8e0 con 0x7fb92808e4c0 2023-03-03T07:45:12.908 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.904+0000 7fb92cfc3700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb92808f760 con 0x7fb92812ab20 2023-03-03T07:45:12.908 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.904+0000 7fb926ffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb92812ab20 0x7fb92812cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:45:12.908 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.904+0000 7fb926ffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb92812ab20 0x7fb92812cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50658/0 (socket says 172.21.15.57:50658) 2023-03-03T07:45:12.909 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.904+0000 7fb926ffd700 1 -- 172.21.15.57:0/493451213 learned_addr learned my addr 172.21.15.57:0/493451213 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:45:12.909 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.904+0000 7fb926ffd700 1 -- 172.21.15.57:0/493451213 >> v1:172.21.15.57:6789/0 conn(0x7fb92808e4c0 legacy=0x7fb92808e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:45:12.909 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.904+0000 7fb926ffd700 1 -- 172.21.15.57:0/493451213 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb928090650 con 0x7fb92812ab20 2023-03-03T07:45:12.910 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.904+0000 7fb926ffd700 1 --2- 172.21.15.57:0/493451213 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb92812ab20 0x7fb92812cf00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb91c009890 tx=0x7fb91c009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35e515dcce692377 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:45:12.910 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.904+0000 7fb9267fc700 1 -- 172.21.15.57:0/493451213 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb91c004160 con 0x7fb92812ab20 2023-03-03T07:45:12.910 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.904+0000 7fb9267fc700 1 -- 172.21.15.57:0/493451213 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb91c0042c0 con 0x7fb92812ab20 2023-03-03T07:45:12.910 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.904+0000 7fb9267fc700 1 -- 172.21.15.57:0/493451213 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb91c004580 con 0x7fb92812ab20 2023-03-03T07:45:12.911 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.908+0000 7fb92cfc3700 1 -- 172.21.15.57:0/493451213 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb92812ab20 msgr2=0x7fb92812cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:45:12.911 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.908+0000 7fb92cfc3700 1 --2- 172.21.15.57:0/493451213 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb92812ab20 0x7fb92812cf00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb91c009890 tx=0x7fb91c009ba0 comp rx=0 tx=0).stop 2023-03-03T07:45:12.912 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.908+0000 7fb92cfc3700 1 -- 172.21.15.57:0/493451213 shutdown_connections 2023-03-03T07:45:12.912 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.908+0000 7fb92cfc3700 1 --2- 172.21.15.57:0/493451213 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb92812ab20 0x7fb92812cf00 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:45:12.912 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.908+0000 7fb92cfc3700 1 -- 172.21.15.57:0/493451213 >> 172.21.15.57:0/493451213 conn(0x7fb928089fa0 msgr2=0x7fb92808c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:45:12.912 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.908+0000 7fb92cfc3700 1 -- 172.21.15.57:0/493451213 shutdown_connections 2023-03-03T07:45:12.913 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.908+0000 7fb92cfc3700 1 -- 172.21.15.57:0/493451213 wait complete. 2023-03-03T07:45:12.914 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.908+0000 7fb92cfc3700 1 Processor -- start 2023-03-03T07:45:12.915 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.912+0000 7fb92cfc3700 1 -- start start 2023-03-03T07:45:12.916 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.912+0000 7fb92cfc3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb92808e4c0 0x7fb928117670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:45:12.917 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.912+0000 7fb92cfc3700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb92811a250 con 0x7fb92808e4c0 2023-03-03T07:45:12.917 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.912+0000 7fb9277fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb92808e4c0 0x7fb928117670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:45:12.917 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.912+0000 7fb9277fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb92808e4c0 0x7fb928117670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50672/0 (socket says 172.21.15.57:50672) 2023-03-03T07:45:12.918 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.912+0000 7fb9277fe700 1 -- 172.21.15.57:0/2738437495 learned_addr learned my addr 172.21.15.57:0/2738437495 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:45:12.918 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.912+0000 7fb9277fe700 1 -- 172.21.15.57:0/2738437495 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb91c009570 con 0x7fb92808e4c0 2023-03-03T07:45:12.918 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.912+0000 7fb9277fe700 1 --2- 172.21.15.57:0/2738437495 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb92808e4c0 0x7fb928117670 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb91800c480 tx=0x7fb91800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:45:12.919 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.916+0000 7fb90ffff700 1 -- 172.21.15.57:0/2738437495 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb918005150 con 0x7fb92808e4c0 2023-03-03T07:45:12.919 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.916+0000 7fb90ffff700 1 -- 172.21.15.57:0/2738437495 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9180052b0 con 0x7fb92808e4c0 2023-03-03T07:45:12.920 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.916+0000 7fb92cfc3700 1 -- 172.21.15.57:0/2738437495 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb92812d5d0 con 0x7fb92808e4c0 2023-03-03T07:45:12.920 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.916+0000 7fb90ffff700 1 -- 172.21.15.57:0/2738437495 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb918005590 con 0x7fb92808e4c0 2023-03-03T07:45:12.920 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.916+0000 7fb92cfc3700 1 -- 172.21.15.57:0/2738437495 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb92812d440 con 0x7fb92808e4c0 2023-03-03T07:45:12.921 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.916+0000 7fb92cfc3700 1 -- 172.21.15.57:0/2738437495 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb92812d760 con 0x7fb92808e4c0 2023-03-03T07:45:12.921 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.916+0000 7fb90ffff700 1 -- 172.21.15.57:0/2738437495 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 42245+0+0 (secure 0 0 0) 0x7fb918010050 con 0x7fb92808e4c0 2023-03-03T07:45:12.922 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.916+0000 7fb90ffff700 1 --2- 172.21.15.57:0/2738437495 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fb9140347b0 0x7fb914036c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:45:12.923 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.916+0000 7fb90ffff700 1 -- 172.21.15.57:0/2738437495 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 2928+0+0 (secure 0 0 0) 0x7fb918045540 con 0x7fb92808e4c0 2023-03-03T07:45:12.923 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.920+0000 7fb90ffff700 1 -- 172.21.15.57:0/2738437495 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=24}) v3 -- 0x7fb91403b050 con 0x7fb92808e4c0 2023-03-03T07:45:12.923 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.920+0000 7fb926ffd700 1 --2- 172.21.15.57:0/2738437495 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fb9140347b0 0x7fb914036c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:45:12.924 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.920+0000 7fb926ffd700 1 --2- 172.21.15.57:0/2738437495 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fb9140347b0 0x7fb914036c60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb928092370 tx=0x7fb91c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:45:12.930 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:12.924+0000 7fb90ffff700 1 -- 172.21.15.57:0/2738437495 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb918007030 con 0x7fb92808e4c0 2023-03-03T07:45:13.141 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:13.136+0000 7fb92cfc3700 1 -- 172.21.15.57:0/2738437495 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 0: {"prefix": "fs subvolume info", "vol_name": "cephfs", "sub_name": "sub_0", "target": ["mon-mgr", ""]}) v1 -- 0x7fb928119ff0 con 0x7fb9140347b0 2023-03-03T07:45:13.147 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:45:13.144+0000 7fde62304700 -1 mgr.server reply reply (2) No such file or directory subvolume 'sub_0' does not exist 2023-03-03T07:45:13.147 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:13.144+0000 7fb90ffff700 1 -- 172.21.15.57:0/2738437495 <== mgr.4099 v2:172.21.15.57:6808/28565 1 ==== mgr_command_reply(tid 0: -2 subvolume 'sub_0' does not exist) v1 ==== 40+0+0 (secure 0 0 0) 0x7fb928119ff0 con 0x7fb9140347b0 2023-03-03T07:45:13.151 INFO:tasks.workunit.client.0.smithi057.stderr:Error ENOENT: subvolume 'sub_0' does not exist 2023-03-03T07:45:13.167 INFO:tasks.workunit.client.0.smithi057.stderr:+ return 0 2023-03-03T07:45:13.168 INFO:tasks.workunit.client.0.smithi057.stderr:+ trashdir=/home/ubuntu/cephtest/mnt.0/volumes/_deleting 2023-03-03T07:45:13.168 INFO:tasks.workunit.client.0.smithi057.stderr:+ timeout=30 2023-03-03T07:45:13.168 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 30 -gt 0 ']' 2023-03-03T07:45:13.176 INFO:tasks.workunit.client.0.smithi057.stderr:++ sudo ls -A /home/ubuntu/cephtest/mnt.0/volumes/_deleting 2023-03-03T07:45:13.212 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' -z '' ']' 2023-03-03T07:45:13.213 INFO:tasks.workunit.client.0.smithi057.stderr:+ echo 'Trash directory /home/ubuntu/cephtest/mnt.0/volumes/_deleting is empty' 2023-03-03T07:45:13.213 INFO:tasks.workunit.client.0.smithi057.stderr:+ break 2023-03-03T07:45:13.213 INFO:tasks.workunit.client.0.smithi057.stdout:Trash directory /home/ubuntu/cephtest/mnt.0/volumes/_deleting is empty 2023-03-03T07:45:13.214 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph osd set-full-ratio 0.95 2023-03-03T07:45:13.384 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:13.380+0000 7f3a73190700 1 Processor -- start 2023-03-03T07:45:13.385 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:13.380+0000 7f3a73190700 1 -- start start 2023-03-03T07:45:13.385 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:13.380+0000 7f3a73190700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3a6c0712c0 0x7f3a6c071690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:45:13.386 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:13.380+0000 7f3a73190700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a6c08f7a0 con 0x7f3a6c08afb0 2023-03-03T07:45:13.386 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:13.380+0000 7f3a73190700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a6c08f590 con 0x7f3a6c0712c0 2023-03-03T07:45:13.386 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:13.380+0000 7f3a7218e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3a6c0712c0 0x7f3a6c071690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:45:13.387 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:13.380+0000 7f3a7218e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3a6c0712c0 0x7f3a6c071690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50680/0 (socket says 172.21.15.57:50680) 2023-03-03T07:45:13.387 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:13.380+0000 7f3a7198d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f3a6c08afb0 0x7f3a6c08b410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:38604/0 (socket says 172.21.15.57:38604) 2023-03-03T07:45:13.387 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:13.380+0000 7f3a7218e700 1 -- 172.21.15.57:0/1438144454 learned_addr learned my addr 172.21.15.57:0/1438144454 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:45:13.387 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:13.380+0000 7f3a7218e700 1 -- 172.21.15.57:0/1438144454 >> v1:172.21.15.57:6789/0 conn(0x7f3a6c08afb0 legacy=0x7f3a6c08b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:45:13.387 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:13.384+0000 7f3a7218e700 1 -- 172.21.15.57:0/1438144454 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a6c08fab0 con 0x7f3a6c0712c0 2023-03-03T07:45:13.387 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:13.380+0000 7f3a7118c700 1 -- 172.21.15.57:0/1438144454 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3065553628 0 0) 0x7f3a6c08f7a0 con 0x7f3a6c08afb0 2023-03-03T07:45:13.388 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:13.384+0000 7f3a7218e700 1 --2- 172.21.15.57:0/1438144454 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a6c0712c0 0x7f3a6c071690 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3a68009890 tx=0x7f3a68009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a40f3c83b8617dfc server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:45:13.388 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:13.384+0000 7f3a7118c700 1 -- 172.21.15.57:0/1438144454 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a68004160 con 0x7f3a6c0712c0 2023-03-03T07:45:13.388 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:13.384+0000 7f3a7118c700 1 -- 172.21.15.57:0/1438144454 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a680042c0 con 0x7f3a6c0712c0 2023-03-03T07:45:13.389 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:13.384+0000 7f3a7118c700 1 -- 172.21.15.57:0/1438144454 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a68004580 con 0x7f3a6c0712c0 2023-03-03T07:45:13.389 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:13.384+0000 7f3a73190700 1 -- 172.21.15.57:0/1438144454 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a6c0712c0 msgr2=0x7f3a6c071690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:45:13.389 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:13.384+0000 7f3a73190700 1 --2- 172.21.15.57:0/1438144454 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a6c0712c0 0x7f3a6c071690 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3a68009890 tx=0x7f3a68009ba0 comp rx=0 tx=0).stop 2023-03-03T07:45:13.390 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:13.384+0000 7f3a73190700 1 -- 172.21.15.57:0/1438144454 shutdown_connections 2023-03-03T07:45:13.390 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:13.384+0000 7f3a73190700 1 --2- 172.21.15.57:0/1438144454 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a6c0712c0 0x7f3a6c071690 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:45:13.391 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:13.384+0000 7f3a73190700 1 -- 172.21.15.57:0/1438144454 >> 172.21.15.57:0/1438144454 conn(0x7f3a6c0943e0 msgr2=0x7f3a6c095e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:45:13.391 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:13.384+0000 7f3a73190700 1 -- 172.21.15.57:0/1438144454 shutdown_connections 2023-03-03T07:45:13.391 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:13.384+0000 7f3a73190700 1 -- 172.21.15.57:0/1438144454 wait complete. 2023-03-03T07:45:13.392 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:13.388+0000 7f3a73190700 1 Processor -- start 2023-03-03T07:45:13.393 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:13.388+0000 7f3a73190700 1 -- start start 2023-03-03T07:45:13.394 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:13.388+0000 7f3a73190700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a6c0712c0 0x7f3a6c1b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:45:13.394 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:13.388+0000 7f3a73190700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6c11e4f0 con 0x7f3a6c0712c0 2023-03-03T07:45:13.395 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:13.388+0000 7f3a7218e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a6c0712c0 0x7f3a6c1b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:45:13.395 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:13.388+0000 7f3a7218e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a6c0712c0 0x7f3a6c1b8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50682/0 (socket says 172.21.15.57:50682) 2023-03-03T07:45:13.395 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:13.388+0000 7f3a7218e700 1 -- 172.21.15.57:0/4282164457 learned_addr learned my addr 172.21.15.57:0/4282164457 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:45:13.395 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:13.392+0000 7f3a7218e700 1 -- 172.21.15.57:0/4282164457 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a68009570 con 0x7f3a6c0712c0 2023-03-03T07:45:13.396 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:13.392+0000 7f3a7218e700 1 --2- 172.21.15.57:0/4282164457 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a6c0712c0 0x7f3a6c1b8a60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3a68009fd0 tx=0x7f3a68004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:45:13.396 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:13.392+0000 7f3a62ffd700 1 -- 172.21.15.57:0/4282164457 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a6800b670 con 0x7f3a6c0712c0 2023-03-03T07:45:13.396 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:13.392+0000 7f3a62ffd700 1 -- 172.21.15.57:0/4282164457 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a6800b7d0 con 0x7f3a6c0712c0 2023-03-03T07:45:13.397 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:13.392+0000 7f3a62ffd700 1 -- 172.21.15.57:0/4282164457 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a6800bab0 con 0x7f3a6c0712c0 2023-03-03T07:45:13.397 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:13.392+0000 7f3a73190700 1 -- 172.21.15.57:0/4282164457 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a6c08bcb0 con 0x7f3a6c0712c0 2023-03-03T07:45:13.397 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:13.392+0000 7f3a73190700 1 -- 172.21.15.57:0/4282164457 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a6c08bb20 con 0x7f3a6c0712c0 2023-03-03T07:45:13.399 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:13.396+0000 7f3a62ffd700 1 -- 172.21.15.57:0/4282164457 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 7) v1 ==== 42325+0+0 (secure 0 0 0) 0x7f3a68017020 con 0x7f3a6c0712c0 2023-03-03T07:45:13.399 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:13.396+0000 7f3a73190700 1 -- 172.21.15.57:0/4282164457 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a6c12b670 con 0x7f3a6c0712c0 2023-03-03T07:45:13.400 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:13.396+0000 7f3a62ffd700 1 --2- 172.21.15.57:0/4282164457 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f3a50034910 0x7f3a50036dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:45:13.400 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:13.396+0000 7f3a62ffd700 1 -- 172.21.15.57:0/4282164457 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 2928+0+0 (secure 0 0 0) 0x7f3a68047ee0 con 0x7f3a6c0712c0 2023-03-03T07:45:13.401 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:13.396+0000 7f3a62ffd700 1 -- 172.21.15.57:0/4282164457 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=24}) v3 -- 0x7f3a5003b1b0 con 0x7f3a6c0712c0 2023-03-03T07:45:13.401 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:13.396+0000 7f3a7198d700 1 --2- 172.21.15.57:0/4282164457 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f3a50034910 0x7f3a50036dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:45:13.402 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:13.396+0000 7f3a7198d700 1 --2- 172.21.15.57:0/4282164457 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f3a50034910 0x7f3a50036dc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c000c00 tx=0x7f3a5c0079e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:45:13.408 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:13.404+0000 7f3a62ffd700 1 -- 172.21.15.57:0/4282164457 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f3a680193c0 con 0x7f3a6c0712c0 2023-03-03T07:45:13.592 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:13.588+0000 7f3a73190700 1 -- 172.21.15.57:0/4282164457 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd set-full-ratio", "ratio": 0.95} v 0) v1 -- 0x7f3a6c11e630 con 0x7f3a6c0712c0 2023-03-03T07:45:14.379 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:14.376+0000 7f3a62ffd700 1 -- 172.21.15.57:0/4282164457 <== mon.0 v2:172.21.15.57:3300/0 7 ==== osd_map(24..24 src has 1..24) v4 ==== 288+0+0 (secure 0 0 0) 0x7f3a68010380 con 0x7f3a6c0712c0 2023-03-03T07:45:14.380 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:14.376+0000 7f3a62ffd700 1 -- 172.21.15.57:0/4282164457 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=25}) v3 -- 0x7f3a5003ba60 con 0x7f3a6c0712c0 2023-03-03T07:45:14.382 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:14.376+0000 7f3a62ffd700 1 -- 172.21.15.57:0/4282164457 <== mon.0 v2:172.21.15.57:3300/0 8 ==== mon_command_ack([{"prefix": "osd set-full-ratio", "ratio": 0.95}]=0 osd set-full-ratio 0.95 v24) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3a6803b060 con 0x7f3a6c0712c0 2023-03-03T07:45:14.497 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:14.492+0000 7f3a73190700 1 -- 172.21.15.57:0/4282164457 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd set-full-ratio", "ratio": 0.95} v 0) v1 -- 0x7f3a6c0008d0 con 0x7f3a6c0712c0 2023-03-03T07:45:15.382 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:15.376+0000 7f3a62ffd700 1 -- 172.21.15.57:0/4282164457 <== mon.0 v2:172.21.15.57:3300/0 9 ==== osd_map(25..25 src has 1..25) v4 ==== 288+0+0 (secure 0 0 0) 0x7f3a6801ae20 con 0x7f3a6c0712c0 2023-03-03T07:45:15.383 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:15.376+0000 7f3a62ffd700 1 -- 172.21.15.57:0/4282164457 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=26}) v3 -- 0x7f3a5003bbb0 con 0x7f3a6c0712c0 2023-03-03T07:45:15.386 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:15.380+0000 7f3a62ffd700 1 -- 172.21.15.57:0/4282164457 <== mon.0 v2:172.21.15.57:3300/0 10 ==== mon_command_ack([{"prefix": "osd set-full-ratio", "ratio": 0.95}]=0 osd set-full-ratio 0.95 v25) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3a6c11e630 con 0x7f3a6c0712c0 2023-03-03T07:45:15.391 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:15.388+0000 7f3a73190700 1 -- 172.21.15.57:0/4282164457 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f3a50034910 msgr2=0x7f3a50036dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:45:15.392 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:15.388+0000 7f3a73190700 1 --2- 172.21.15.57:0/4282164457 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f3a50034910 0x7f3a50036dc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c000c00 tx=0x7f3a5c0079e0 comp rx=0 tx=0).stop 2023-03-03T07:45:15.392 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:15.388+0000 7f3a73190700 1 -- 172.21.15.57:0/4282164457 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a6c0712c0 msgr2=0x7f3a6c1b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:45:15.392 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:15.388+0000 7f3a73190700 1 --2- 172.21.15.57:0/4282164457 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a6c0712c0 0x7f3a6c1b8a60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3a68009fd0 tx=0x7f3a68004770 comp rx=0 tx=0).stop 2023-03-03T07:45:15.393 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:15.388+0000 7f3a73190700 1 -- 172.21.15.57:0/4282164457 shutdown_connections 2023-03-03T07:45:15.393 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:15.388+0000 7f3a73190700 1 --2- 172.21.15.57:0/4282164457 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f3a50034910 0x7f3a50036dc0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:45:15.393 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:15.388+0000 7f3a73190700 1 --2- 172.21.15.57:0/4282164457 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a6c0712c0 0x7f3a6c1b8a60 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:45:15.393 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:15.388+0000 7f3a73190700 1 -- 172.21.15.57:0/4282164457 >> 172.21.15.57:0/4282164457 conn(0x7f3a6c0943e0 msgr2=0x7f3a6c12a840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:45:15.393 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:15.388+0000 7f3a73190700 1 -- 172.21.15.57:0/4282164457 shutdown_connections 2023-03-03T07:45:15.393 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:15.388+0000 7f3a73190700 1 -- 172.21.15.57:0/4282164457 wait complete. 2023-03-03T07:45:15.394 INFO:tasks.workunit.client.0.smithi057.stderr:osd set-full-ratio 0.95 2023-03-03T07:45:15.417 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph osd set-nearfull-ratio 0.95 2023-03-03T07:45:15.588 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:15.584+0000 7feabeffb700 1 Processor -- start 2023-03-03T07:45:15.589 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:15.584+0000 7feabeffb700 1 -- start start 2023-03-03T07:45:15.590 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:15.584+0000 7feabeffb700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7feab8091a10 0x7feab808e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:45:15.590 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:15.584+0000 7feabeffb700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feab80911f0 con 0x7feab8091de0 2023-03-03T07:45:15.591 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:15.584+0000 7feabeffb700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feab80662f0 con 0x7feab8091a10 2023-03-03T07:45:15.591 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:15.588+0000 7feabdff9700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7feab8091a10 0x7feab808e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:45:15.591 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:15.588+0000 7feabdff9700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7feab8091a10 0x7feab808e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50698/0 (socket says 172.21.15.57:50698) 2023-03-03T07:45:15.592 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:15.588+0000 7feabd7f8700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7feab8091de0 0x7feab808ec70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:38608/0 (socket says 172.21.15.57:38608) 2023-03-03T07:45:15.592 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:15.588+0000 7feabdff9700 1 -- 172.21.15.57:0/1455278145 learned_addr learned my addr 172.21.15.57:0/1455278145 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:45:15.593 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:15.588+0000 7feabdff9700 1 -- 172.21.15.57:0/1455278145 >> v1:172.21.15.57:6789/0 conn(0x7feab8091de0 legacy=0x7feab808ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:45:15.593 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:15.588+0000 7feabdff9700 1 -- 172.21.15.57:0/1455278145 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab8066700 con 0x7feab8091a10 2023-03-03T07:45:15.593 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:15.588+0000 7feabcff7700 1 -- 172.21.15.57:0/1455278145 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 130770009 0 0) 0x7feab80911f0 con 0x7feab8091de0 2023-03-03T07:45:15.594 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:15.588+0000 7feabdff9700 1 --2- 172.21.15.57:0/1455278145 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feab8091a10 0x7feab808e730 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7feab4009890 tx=0x7feab4009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4475bf680b26e74 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:45:15.594 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:15.588+0000 7feabcff7700 1 -- 172.21.15.57:0/1455278145 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feab4004160 con 0x7feab8091a10 2023-03-03T07:45:15.594 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:15.588+0000 7feabcff7700 1 -- 172.21.15.57:0/1455278145 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feab40042c0 con 0x7feab8091a10 2023-03-03T07:45:15.594 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:15.588+0000 7feabcff7700 1 -- 172.21.15.57:0/1455278145 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feab4004580 con 0x7feab8091a10 2023-03-03T07:45:15.595 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:15.592+0000 7feabeffb700 1 -- 172.21.15.57:0/1455278145 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feab8091a10 msgr2=0x7feab808e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:45:15.595 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:15.592+0000 7feabeffb700 1 --2- 172.21.15.57:0/1455278145 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feab8091a10 0x7feab808e730 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7feab4009890 tx=0x7feab4009ba0 comp rx=0 tx=0).stop 2023-03-03T07:45:15.595 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:15.592+0000 7feabeffb700 1 -- 172.21.15.57:0/1455278145 shutdown_connections 2023-03-03T07:45:15.596 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:15.592+0000 7feabeffb700 1 --2- 172.21.15.57:0/1455278145 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feab8091a10 0x7feab808e730 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:45:15.596 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:15.592+0000 7feabeffb700 1 -- 172.21.15.57:0/1455278145 >> 172.21.15.57:0/1455278145 conn(0x7feab808a3c0 msgr2=0x7feab808c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:45:15.596 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:15.592+0000 7feabeffb700 1 -- 172.21.15.57:0/1455278145 shutdown_connections 2023-03-03T07:45:15.596 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:15.592+0000 7feabeffb700 1 -- 172.21.15.57:0/1455278145 wait complete. 2023-03-03T07:45:15.599 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:15.596+0000 7feabeffb700 1 Processor -- start 2023-03-03T07:45:15.599 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:15.596+0000 7feabeffb700 1 -- start start 2023-03-03T07:45:15.600 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:15.596+0000 7feabeffb700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feab8091a10 0x7feab81bbea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:45:15.601 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:15.596+0000 7feabeffb700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab811eac0 con 0x7feab8091a10 2023-03-03T07:45:15.601 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:15.596+0000 7feabdff9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feab8091a10 0x7feab81bbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:45:15.601 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:15.596+0000 7feabdff9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feab8091a10 0x7feab81bbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50706/0 (socket says 172.21.15.57:50706) 2023-03-03T07:45:15.601 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:15.596+0000 7feabdff9700 1 -- 172.21.15.57:0/793064252 learned_addr learned my addr 172.21.15.57:0/793064252 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:45:15.602 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:15.596+0000 7feabdff9700 1 -- 172.21.15.57:0/793064252 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab4009570 con 0x7feab8091a10 2023-03-03T07:45:15.602 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:15.596+0000 7feabdff9700 1 --2- 172.21.15.57:0/793064252 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feab8091a10 0x7feab81bbea0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7feab4009fd0 tx=0x7feab4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:45:15.603 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:15.600+0000 7feaae7fc700 1 -- 172.21.15.57:0/793064252 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feab400b670 con 0x7feab8091a10 2023-03-03T07:45:15.603 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:15.600+0000 7feaae7fc700 1 -- 172.21.15.57:0/793064252 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feab400b7d0 con 0x7feab8091a10 2023-03-03T07:45:15.603 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:15.600+0000 7feabeffb700 1 -- 172.21.15.57:0/793064252 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feab8090f00 con 0x7feab8091a10 2023-03-03T07:45:15.603 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:15.600+0000 7feaae7fc700 1 -- 172.21.15.57:0/793064252 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feab400bab0 con 0x7feab8091a10 2023-03-03T07:45:15.604 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:15.600+0000 7feabeffb700 1 -- 172.21.15.57:0/793064252 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feab808f590 con 0x7feab8091a10 2023-03-03T07:45:15.605 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:15.600+0000 7feabeffb700 1 -- 172.21.15.57:0/793064252 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feab812d720 con 0x7feab8091a10 2023-03-03T07:45:15.605 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:15.600+0000 7feaae7fc700 1 -- 172.21.15.57:0/793064252 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 7) v1 ==== 42325+0+0 (secure 0 0 0) 0x7feab4017020 con 0x7feab8091a10 2023-03-03T07:45:15.606 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:15.600+0000 7feaae7fc700 1 --2- 172.21.15.57:0/793064252 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fea9c034910 0x7fea9c036dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:45:15.607 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:15.604+0000 7feaae7fc700 1 -- 172.21.15.57:0/793064252 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 2928+0+0 (secure 0 0 0) 0x7feab4047f60 con 0x7feab8091a10 2023-03-03T07:45:15.607 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:15.604+0000 7feabd7f8700 1 --2- 172.21.15.57:0/793064252 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fea9c034910 0x7fea9c036dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:45:15.607 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:15.604+0000 7feaae7fc700 1 -- 172.21.15.57:0/793064252 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=26}) v3 -- 0x7fea9c03b1b0 con 0x7feab8091a10 2023-03-03T07:45:15.608 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:15.604+0000 7feabd7f8700 1 --2- 172.21.15.57:0/793064252 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fea9c034910 0x7fea9c036dc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7feaa8000c00 tx=0x7feaa80079c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:45:15.613 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:15.608+0000 7feaae7fc700 1 -- 172.21.15.57:0/793064252 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7feab40193c0 con 0x7feab8091a10 2023-03-03T07:45:15.795 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:15.792+0000 7feabeffb700 1 -- 172.21.15.57:0/793064252 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd set-nearfull-ratio", "ratio": 0.95} v 0) v1 -- 0x7feab80619b0 con 0x7feab8091a10 2023-03-03T07:45:16.390 INFO:tasks.ceph.mon.a.smithi057.stderr:2023-03-03T07:45:16.384+0000 7fcc0ddf9700 -1 log_channel(cluster) log [ERR] : Health check failed: full ratio(s) out of order (OSD_OUT_OF_ORDER_FULL) 2023-03-03T07:45:16.396 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:16.392+0000 7feaae7fc700 1 -- 172.21.15.57:0/793064252 <== mon.0 v2:172.21.15.57:3300/0 7 ==== osd_map(26..26 src has 1..26) v4 ==== 1806+0+0 (secure 0 0 0) 0x7feab40470f0 con 0x7feab8091a10 2023-03-03T07:45:16.396 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:16.392+0000 7feaae7fc700 1 -- 172.21.15.57:0/793064252 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=27}) v3 -- 0x7fea9c03c710 con 0x7feab8091a10 2023-03-03T07:45:16.400 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:16.396+0000 7feaae7fc700 1 -- 172.21.15.57:0/793064252 <== mon.0 v2:172.21.15.57:3300/0 8 ==== mon_command_ack([{"prefix": "osd set-nearfull-ratio", "ratio": 0.95}]=0 osd set-nearfull-ratio 0.95 v26) v1 ==== 112+0+0 (secure 0 0 0) 0x7feab403b060 con 0x7feab8091a10 2023-03-03T07:45:16.512 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:16.508+0000 7feabeffb700 1 -- 172.21.15.57:0/793064252 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd set-nearfull-ratio", "ratio": 0.95} v 0) v1 -- 0x7feab80619b0 con 0x7feab8091a10 2023-03-03T07:45:17.407 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:17.404+0000 7feaae7fc700 1 -- 172.21.15.57:0/793064252 <== mon.0 v2:172.21.15.57:3300/0 9 ==== osd_map(27..27 src has 1..27) v4 ==== 288+0+0 (secure 0 0 0) 0x7feab4010380 con 0x7feab8091a10 2023-03-03T07:45:17.411 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:17.408+0000 7feaae7fc700 1 -- 172.21.15.57:0/793064252 <== mon.0 v2:172.21.15.57:3300/0 10 ==== mon_command_ack([{"prefix": "osd set-nearfull-ratio", "ratio": 0.95}]=0 osd set-nearfull-ratio 0.95 v27) v1 ==== 112+0+0 (secure 0 0 0) 0x7feab402dd40 con 0x7feab8091a10 2023-03-03T07:45:17.418 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:17.412+0000 7feabeffb700 1 -- 172.21.15.57:0/793064252 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fea9c034910 msgr2=0x7fea9c036dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:45:17.419 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:17.412+0000 7feabeffb700 1 --2- 172.21.15.57:0/793064252 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fea9c034910 0x7fea9c036dc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7feaa8000c00 tx=0x7feaa80079c0 comp rx=0 tx=0).stop 2023-03-03T07:45:17.419 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:17.412+0000 7feabeffb700 1 -- 172.21.15.57:0/793064252 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feab8091a10 msgr2=0x7feab81bbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:45:17.419 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:17.412+0000 7feabeffb700 1 --2- 172.21.15.57:0/793064252 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feab8091a10 0x7feab81bbea0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7feab4009fd0 tx=0x7feab4004770 comp rx=0 tx=0).stop 2023-03-03T07:45:17.419 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:17.416+0000 7feabeffb700 1 -- 172.21.15.57:0/793064252 shutdown_connections 2023-03-03T07:45:17.420 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:17.416+0000 7feabeffb700 1 --2- 172.21.15.57:0/793064252 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fea9c034910 0x7fea9c036dc0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:45:17.420 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:17.416+0000 7feabeffb700 1 --2- 172.21.15.57:0/793064252 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feab8091a10 0x7feab81bbea0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:45:17.420 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:17.416+0000 7feabeffb700 1 -- 172.21.15.57:0/793064252 >> 172.21.15.57:0/793064252 conn(0x7feab808a3c0 msgr2=0x7feab812ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:45:17.420 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:17.416+0000 7feabeffb700 1 -- 172.21.15.57:0/793064252 shutdown_connections 2023-03-03T07:45:17.420 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:17.416+0000 7feabeffb700 1 -- 172.21.15.57:0/793064252 wait complete. 2023-03-03T07:45:17.421 INFO:tasks.workunit.client.0.smithi057.stderr:osd set-nearfull-ratio 0.95 2023-03-03T07:45:17.444 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph osd set-backfillfull-ratio 0.95 2023-03-03T07:45:17.615 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:17.612+0000 7fd3a566a700 1 Processor -- start 2023-03-03T07:45:17.615 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:17.612+0000 7fd3a566a700 1 -- start start 2023-03-03T07:45:17.616 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:17.612+0000 7fd3a566a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd3a006aa60 0x7fd3a006ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:45:17.616 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:17.612+0000 7fd3a566a700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3a006c360 con 0x7fd3a006b370 2023-03-03T07:45:17.616 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:17.612+0000 7fd3a566a700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3a0071450 con 0x7fd3a006aa60 2023-03-03T07:45:17.616 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:17.612+0000 7fd39effd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd3a006aa60 0x7fd3a006ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:45:17.617 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:17.612+0000 7fd3967fc700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fd3a006b370 0x7fd3a0130230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:38618/0 (socket says 172.21.15.57:38618) 2023-03-03T07:45:17.617 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:17.612+0000 7fd3967fc700 1 -- 172.21.15.57:0/2148598031 learned_addr learned my addr 172.21.15.57:0/2148598031 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:45:17.617 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:17.612+0000 7fd39effd700 1 -- 172.21.15.57:0/2148598031 >> v1:172.21.15.57:6789/0 conn(0x7fd3a006b370 legacy=0x7fd3a0130230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:45:17.618 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:17.612+0000 7fd39effd700 1 -- 172.21.15.57:0/2148598031 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a006cee0 con 0x7fd3a006aa60 2023-03-03T07:45:17.618 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:17.612+0000 7fd39e7fc700 1 -- 172.21.15.57:0/2148598031 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 98620772 0 0) 0x7fd3a006c360 con 0x7fd3a006b370 2023-03-03T07:45:17.618 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:17.612+0000 7fd39effd700 1 --2- 172.21.15.57:0/2148598031 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3a006aa60 0x7fd3a006ae30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd390009d90 tx=0x7fd39000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac72a53783b1e69f server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:45:17.619 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:17.616+0000 7fd39e7fc700 1 -- 172.21.15.57:0/2148598031 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd39000e070 con 0x7fd3a006aa60 2023-03-03T07:45:17.619 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:17.616+0000 7fd39e7fc700 1 -- 172.21.15.57:0/2148598031 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd39000bc80 con 0x7fd3a006aa60 2023-03-03T07:45:17.619 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:17.616+0000 7fd39e7fc700 1 -- 172.21.15.57:0/2148598031 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd390003a40 con 0x7fd3a006aa60 2023-03-03T07:45:17.620 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:17.616+0000 7fd3a566a700 1 -- 172.21.15.57:0/2148598031 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3a006aa60 msgr2=0x7fd3a006ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:45:17.620 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:17.616+0000 7fd3a566a700 1 --2- 172.21.15.57:0/2148598031 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3a006aa60 0x7fd3a006ae30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd390009d90 tx=0x7fd39000b330 comp rx=0 tx=0).stop 2023-03-03T07:45:17.621 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:17.616+0000 7fd3a566a700 1 -- 172.21.15.57:0/2148598031 shutdown_connections 2023-03-03T07:45:17.621 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:17.616+0000 7fd3a566a700 1 --2- 172.21.15.57:0/2148598031 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3a006aa60 0x7fd3a006ae30 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:45:17.621 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:17.616+0000 7fd3a566a700 1 -- 172.21.15.57:0/2148598031 >> 172.21.15.57:0/2148598031 conn(0x7fd3a0069f80 msgr2=0x7fd3a006a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:45:17.621 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:17.616+0000 7fd3a566a700 1 -- 172.21.15.57:0/2148598031 shutdown_connections 2023-03-03T07:45:17.621 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:17.616+0000 7fd3a566a700 1 -- 172.21.15.57:0/2148598031 wait complete. 2023-03-03T07:45:17.623 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:17.620+0000 7fd3a566a700 1 Processor -- start 2023-03-03T07:45:17.624 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:17.620+0000 7fd3a566a700 1 -- start start 2023-03-03T07:45:17.625 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:17.620+0000 7fd3a566a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3a006aa60 0x7fd3a0125e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:45:17.625 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:17.620+0000 7fd3a566a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a0125620 con 0x7fd3a006aa60 2023-03-03T07:45:17.625 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:17.620+0000 7fd39effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3a006aa60 0x7fd3a0125e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:45:17.626 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:17.620+0000 7fd39effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3a006aa60 0x7fd3a0125e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50720/0 (socket says 172.21.15.57:50720) 2023-03-03T07:45:17.626 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:17.620+0000 7fd39effd700 1 -- 172.21.15.57:0/460749115 learned_addr learned my addr 172.21.15.57:0/460749115 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:45:17.626 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:17.620+0000 7fd39effd700 1 -- 172.21.15.57:0/460749115 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd390009a70 con 0x7fd3a006aa60 2023-03-03T07:45:17.627 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:17.624+0000 7fd39effd700 1 --2- 172.21.15.57:0/460749115 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3a006aa60 0x7fd3a0125e30 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd390000f80 tx=0x7fd390004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:45:17.627 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:17.624+0000 7fd397fff700 1 -- 172.21.15.57:0/460749115 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd390004710 con 0x7fd3a006aa60 2023-03-03T07:45:17.627 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:17.624+0000 7fd397fff700 1 -- 172.21.15.57:0/460749115 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd390004870 con 0x7fd3a006aa60 2023-03-03T07:45:17.628 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:17.624+0000 7fd3a566a700 1 -- 172.21.15.57:0/460749115 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3a0131950 con 0x7fd3a006aa60 2023-03-03T07:45:17.628 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:17.624+0000 7fd397fff700 1 -- 172.21.15.57:0/460749115 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd390012560 con 0x7fd3a006aa60 2023-03-03T07:45:17.628 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:17.624+0000 7fd3a566a700 1 -- 172.21.15.57:0/460749115 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3a006d2b0 con 0x7fd3a006aa60 2023-03-03T07:45:17.629 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:17.624+0000 7fd397fff700 1 -- 172.21.15.57:0/460749115 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 7) v1 ==== 42325+0+0 (secure 0 0 0) 0x7fd3900126c0 con 0x7fd3a006aa60 2023-03-03T07:45:17.629 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:17.624+0000 7fd3a566a700 1 -- 172.21.15.57:0/460749115 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3a0131ae0 con 0x7fd3a006aa60 2023-03-03T07:45:17.630 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:17.624+0000 7fd397fff700 1 --2- 172.21.15.57:0/460749115 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fd380034910 0x7fd380036dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:45:17.630 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:17.624+0000 7fd397fff700 1 -- 172.21.15.57:0/460749115 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 2928+0+0 (secure 0 0 0) 0x7fd3900488e0 con 0x7fd3a006aa60 2023-03-03T07:45:17.630 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:17.628+0000 7fd3967fc700 1 --2- 172.21.15.57:0/460749115 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fd380034910 0x7fd380036dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:45:17.631 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:17.628+0000 7fd3967fc700 1 --2- 172.21.15.57:0/460749115 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fd380034910 0x7fd380036dc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd3880011e0 tx=0x7fd3880079e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:45:17.638 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:17.632+0000 7fd397fff700 1 -- 172.21.15.57:0/460749115 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd39001ce10 con 0x7fd3a006aa60 2023-03-03T07:45:17.818 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:17.812+0000 7fd3a566a700 1 -- 172.21.15.57:0/460749115 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd set-backfillfull-ratio", "ratio": 0.95} v 0) v1 -- 0x7fd3a0125760 con 0x7fd3a006aa60 2023-03-03T07:45:18.424 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:18.420+0000 7fd397fff700 1 -- 172.21.15.57:0/460749115 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd set-backfillfull-ratio", "ratio": 0.95}]=0 osd set-backfillfull-ratio 0.95 v28) v1 ==== 120+0+0 (secure 0 0 0) 0x7fd3a0125760 con 0x7fd3a006aa60 2023-03-03T07:45:18.538 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:18.532+0000 7fd3a566a700 1 -- 172.21.15.57:0/460749115 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd set-backfillfull-ratio", "ratio": 0.95} v 0) v1 -- 0x7fd3a0125760 con 0x7fd3a006aa60 2023-03-03T07:45:19.436 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.432+0000 7fd397fff700 1 -- 172.21.15.57:0/460749115 <== mon.0 v2:172.21.15.57:3300/0 8 ==== mon_command_ack([{"prefix": "osd set-backfillfull-ratio", "ratio": 0.95}]=0 osd set-backfillfull-ratio 0.95 v29) v1 ==== 120+0+0 (secure 0 0 0) 0x7fd3a0125760 con 0x7fd3a006aa60 2023-03-03T07:45:19.442 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.436+0000 7fd3a566a700 1 -- 172.21.15.57:0/460749115 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fd380034910 msgr2=0x7fd380036dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:45:19.442 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.436+0000 7fd3a566a700 1 --2- 172.21.15.57:0/460749115 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fd380034910 0x7fd380036dc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd3880011e0 tx=0x7fd3880079e0 comp rx=0 tx=0).stop 2023-03-03T07:45:19.443 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.436+0000 7fd3a566a700 1 -- 172.21.15.57:0/460749115 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3a006aa60 msgr2=0x7fd3a0125e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:45:19.443 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.436+0000 7fd3a566a700 1 --2- 172.21.15.57:0/460749115 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3a006aa60 0x7fd3a0125e30 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd390000f80 tx=0x7fd390004af0 comp rx=0 tx=0).stop 2023-03-03T07:45:19.443 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.436+0000 7fd3a566a700 1 -- 172.21.15.57:0/460749115 shutdown_connections 2023-03-03T07:45:19.443 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.436+0000 7fd3a566a700 1 --2- 172.21.15.57:0/460749115 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fd380034910 0x7fd380036dc0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:45:19.443 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.436+0000 7fd3a566a700 1 --2- 172.21.15.57:0/460749115 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3a006aa60 0x7fd3a0125e30 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:45:19.444 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.436+0000 7fd3a566a700 1 -- 172.21.15.57:0/460749115 >> 172.21.15.57:0/460749115 conn(0x7fd3a0069f80 msgr2=0x7fd3a00966a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:45:19.444 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.440+0000 7fd3a566a700 1 -- 172.21.15.57:0/460749115 shutdown_connections 2023-03-03T07:45:19.444 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.440+0000 7fd3a566a700 1 -- 172.21.15.57:0/460749115 wait complete. 2023-03-03T07:45:19.445 INFO:tasks.workunit.client.0.smithi057.stderr:osd set-backfillfull-ratio 0.95 2023-03-03T07:45:19.468 INFO:tasks.workunit.client.0.smithi057.stdout:After test 2023-03-03T07:45:19.468 INFO:tasks.workunit.client.0.smithi057.stderr:+ echo 'After test' 2023-03-03T07:45:19.468 INFO:tasks.workunit.client.0.smithi057.stderr:+ df -h 2023-03-03T07:45:19.478 INFO:tasks.workunit.client.0.smithi057.stdout:Filesystem Size Used Avail Use% Mounted on 2023-03-03T07:45:19.479 INFO:tasks.workunit.client.0.smithi057.stdout:udev 16G 0 16G 0% /dev 2023-03-03T07:45:19.479 INFO:tasks.workunit.client.0.smithi057.stdout:tmpfs 3.2G 1.9M 3.2G 1% /run 2023-03-03T07:45:19.479 INFO:tasks.workunit.client.0.smithi057.stdout:/dev/sda1 916G 17G 854G 2% / 2023-03-03T07:45:19.479 INFO:tasks.workunit.client.0.smithi057.stdout:tmpfs 16G 20K 16G 1% /dev/shm 2023-03-03T07:45:19.479 INFO:tasks.workunit.client.0.smithi057.stdout:tmpfs 5.0M 0 5.0M 0% /run/lock 2023-03-03T07:45:19.479 INFO:tasks.workunit.client.0.smithi057.stdout:tmpfs 16G 0 16G 0% /sys/fs/cgroup 2023-03-03T07:45:19.480 INFO:tasks.workunit.client.0.smithi057.stdout:tmpfs 3.2G 0 3.2G 0% /run/user/1000 2023-03-03T07:45:19.480 INFO:tasks.workunit.client.0.smithi057.stdout:/dev/mapper/vg_nvme-lv_5 15G 72M 15G 1% /var/lib/ceph 2023-03-03T07:45:19.480 INFO:tasks.workunit.client.0.smithi057.stdout:ceph-fuse 956M 0 956M 0% /home/ubuntu/cephtest/mnt.0 2023-03-03T07:45:19.480 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph osd df 2023-03-03T07:45:19.648 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.644+0000 7f7cc90d7700 1 Processor -- start 2023-03-03T07:45:19.649 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.644+0000 7f7cc90d7700 1 -- start start 2023-03-03T07:45:19.650 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.644+0000 7f7cc90d7700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7cc4091a10 0x7f7cc408e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:45:19.651 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.644+0000 7f7cc90d7700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cc40911f0 con 0x7f7cc4091de0 2023-03-03T07:45:19.651 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.644+0000 7f7cc90d7700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cc40662f0 con 0x7f7cc4091a10 2023-03-03T07:45:19.651 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.648+0000 7f7cc3fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7cc4091a10 0x7f7cc408e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:45:19.652 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.648+0000 7f7cc3fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7cc4091a10 0x7f7cc408e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55630/0 (socket says 172.21.15.57:55630) 2023-03-03T07:45:19.652 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.648+0000 7f7cc3fff700 1 -- 172.21.15.57:0/2635520303 learned_addr learned my addr 172.21.15.57:0/2635520303 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:45:19.652 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.648+0000 7f7cc3fff700 1 -- 172.21.15.57:0/2635520303 >> v1:172.21.15.57:6789/0 conn(0x7f7cc4091de0 legacy=0x7f7cc408ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:45:19.653 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.648+0000 7f7cc3fff700 1 -- 172.21.15.57:0/2635520303 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc4066700 con 0x7f7cc4091a10 2023-03-03T07:45:19.653 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.648+0000 7f7cc3fff700 1 --2- 172.21.15.57:0/2635520303 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7cc4091a10 0x7f7cc408e730 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7cb4009890 tx=0x7f7cb4009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a02c9fd122b8886 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:45:19.654 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.648+0000 7f7cc2ffd700 1 -- 172.21.15.57:0/2635520303 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7cb4004160 con 0x7f7cc4091a10 2023-03-03T07:45:19.654 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.648+0000 7f7cc2ffd700 1 -- 172.21.15.57:0/2635520303 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb40042c0 con 0x7f7cc4091a10 2023-03-03T07:45:19.654 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.648+0000 7f7cc2ffd700 1 -- 172.21.15.57:0/2635520303 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7cb4004580 con 0x7f7cc4091a10 2023-03-03T07:45:19.654 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.648+0000 7f7cc90d7700 1 -- 172.21.15.57:0/2635520303 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7cc4091a10 msgr2=0x7f7cc408e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:45:19.654 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.648+0000 7f7cc90d7700 1 --2- 172.21.15.57:0/2635520303 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7cc4091a10 0x7f7cc408e730 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7cb4009890 tx=0x7f7cb4009ba0 comp rx=0 tx=0).stop 2023-03-03T07:45:19.655 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.652+0000 7f7cc90d7700 1 -- 172.21.15.57:0/2635520303 shutdown_connections 2023-03-03T07:45:19.655 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.652+0000 7f7cc90d7700 1 --2- 172.21.15.57:0/2635520303 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7cc4091a10 0x7f7cc408e730 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:45:19.655 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.652+0000 7f7cc90d7700 1 -- 172.21.15.57:0/2635520303 >> 172.21.15.57:0/2635520303 conn(0x7f7cc408a3c0 msgr2=0x7f7cc408c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:45:19.655 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.652+0000 7f7cc90d7700 1 -- 172.21.15.57:0/2635520303 shutdown_connections 2023-03-03T07:45:19.656 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.652+0000 7f7cc90d7700 1 -- 172.21.15.57:0/2635520303 wait complete. 2023-03-03T07:45:19.656 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.652+0000 7f7cc90d7700 1 Processor -- start 2023-03-03T07:45:19.657 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.652+0000 7f7cc90d7700 1 -- start start 2023-03-03T07:45:19.658 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.652+0000 7f7cc90d7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7cc4091a10 0x7f7cc41bc040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:45:19.658 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.652+0000 7f7cc90d7700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc4128540 con 0x7f7cc4091a10 2023-03-03T07:45:19.658 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.652+0000 7f7cc3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7cc4091a10 0x7f7cc41bc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:45:19.659 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.652+0000 7f7cc3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7cc4091a10 0x7f7cc41bc040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55642/0 (socket says 172.21.15.57:55642) 2023-03-03T07:45:19.659 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.652+0000 7f7cc3fff700 1 -- 172.21.15.57:0/2107722132 learned_addr learned my addr 172.21.15.57:0/2107722132 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:45:19.659 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.656+0000 7f7cc3fff700 1 -- 172.21.15.57:0/2107722132 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb4009570 con 0x7f7cc4091a10 2023-03-03T07:45:19.660 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.656+0000 7f7cc3fff700 1 --2- 172.21.15.57:0/2107722132 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7cc4091a10 0x7f7cc41bc040 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7cb4009fd0 tx=0x7f7cb4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:45:19.660 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.656+0000 7f7cc0ff9700 1 -- 172.21.15.57:0/2107722132 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7cb400b670 con 0x7f7cc4091a10 2023-03-03T07:45:19.660 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.656+0000 7f7cc0ff9700 1 -- 172.21.15.57:0/2107722132 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb400b7d0 con 0x7f7cc4091a10 2023-03-03T07:45:19.660 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.656+0000 7f7cc0ff9700 1 -- 172.21.15.57:0/2107722132 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7cb400ba70 con 0x7f7cc4091a10 2023-03-03T07:45:19.661 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.656+0000 7f7cc90d7700 1 -- 172.21.15.57:0/2107722132 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cc4090f00 con 0x7f7cc4091a10 2023-03-03T07:45:19.661 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.656+0000 7f7cc90d7700 1 -- 172.21.15.57:0/2107722132 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cc408f590 con 0x7f7cc4091a10 2023-03-03T07:45:19.662 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.656+0000 7f7cc90d7700 1 -- 172.21.15.57:0/2107722132 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cc412d720 con 0x7f7cc4091a10 2023-03-03T07:45:19.663 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.656+0000 7f7cc0ff9700 1 -- 172.21.15.57:0/2107722132 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 7) v1 ==== 42325+0+0 (secure 0 0 0) 0x7f7cb4017020 con 0x7f7cc4091a10 2023-03-03T07:45:19.663 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.660+0000 7f7cc0ff9700 1 --2- 172.21.15.57:0/2107722132 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f7cb0034910 0x7f7cb0036dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:45:19.663 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.660+0000 7f7cc0ff9700 1 -- 172.21.15.57:0/2107722132 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 2928+0+0 (secure 0 0 0) 0x7f7cb4047c20 con 0x7f7cc4091a10 2023-03-03T07:45:19.664 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.660+0000 7f7cc37fe700 1 --2- 172.21.15.57:0/2107722132 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f7cb0034910 0x7f7cb0036dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:45:19.665 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.660+0000 7f7cc37fe700 1 --2- 172.21.15.57:0/2107722132 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f7cb0034910 0x7f7cb0036dc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7cc4092210 tx=0x7f7cb8007b00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:45:19.673 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.668+0000 7f7cc0ff9700 1 -- 172.21.15.57:0/2107722132 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7cb400bbd0 con 0x7f7cc4091a10 2023-03-03T07:45:19.848 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.844+0000 7f7cc90d7700 1 -- 172.21.15.57:0/2107722132 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 0: {"prefix": "osd df", "target": ["mon-mgr", ""]}) v1 -- 0x7f7cc411f060 con 0x7f7cb0034910 2023-03-03T07:45:19.849 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.844+0000 7f7cc0ff9700 1 -- 172.21.15.57:0/2107722132 <== mgr.4099 v2:172.21.15.57:6808/28565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+343 (secure 0 0 0) 0x7f7cc411f060 con 0x7f7cb0034910 2023-03-03T07:45:19.944 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.940+0000 7f7cc90d7700 1 -- 172.21.15.57:0/2107722132 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 1: {"prefix": "osd df", "target": ["mon-mgr", ""]}) v1 -- 0x7f7cc40619b0 con 0x7f7cb0034910 2023-03-03T07:45:19.945 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.940+0000 7f7cc0ff9700 1 -- 172.21.15.57:0/2107722132 <== mgr.4099 v2:172.21.15.57:6808/28565 2 ==== mgr_command_reply(tid 1: 0 ) v1 ==== 8+0+343 (secure 0 0 0) 0x7f7cc40619b0 con 0x7f7cb0034910 2023-03-03T07:45:19.946 INFO:tasks.workunit.client.0.smithi057.stdout:ID CLASS WEIGHT REWEIGHT SIZE RAW USE DATA OMAP META AVAIL %USE VAR PGS STATUS 2023-03-03T07:45:19.946 INFO:tasks.workunit.client.0.smithi057.stdout: 0 ssd 0.00099 1.00000 1 GiB 15 MiB 948 KiB 0 B 14 MiB 1009 MiB 1.43 1.00 105 up 2023-03-03T07:45:19.946 INFO:tasks.workunit.client.0.smithi057.stdout: TOTAL 1 GiB 15 MiB 948 KiB 0 B 14 MiB 1009 MiB 1.43 2023-03-03T07:45:19.947 INFO:tasks.workunit.client.0.smithi057.stdout:MIN/MAX VAR: 1.00/1.00 STDDEV: 0 2023-03-03T07:45:19.947 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.944+0000 7f7cc90d7700 1 -- 172.21.15.57:0/2107722132 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f7cb0034910 msgr2=0x7f7cb0036dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:45:19.948 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.944+0000 7f7cc90d7700 1 --2- 172.21.15.57:0/2107722132 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f7cb0034910 0x7f7cb0036dc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7cc4092210 tx=0x7f7cb8007b00 comp rx=0 tx=0).stop 2023-03-03T07:45:19.948 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.944+0000 7f7cc90d7700 1 -- 172.21.15.57:0/2107722132 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7cc4091a10 msgr2=0x7f7cc41bc040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:45:19.948 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.944+0000 7f7cc90d7700 1 --2- 172.21.15.57:0/2107722132 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7cc4091a10 0x7f7cc41bc040 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7cb4009fd0 tx=0x7f7cb4004770 comp rx=0 tx=0).stop 2023-03-03T07:45:19.948 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.944+0000 7f7cc90d7700 1 -- 172.21.15.57:0/2107722132 shutdown_connections 2023-03-03T07:45:19.948 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.944+0000 7f7cc90d7700 1 --2- 172.21.15.57:0/2107722132 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f7cb0034910 0x7f7cb0036dc0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:45:19.949 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.944+0000 7f7cc90d7700 1 --2- 172.21.15.57:0/2107722132 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7cc4091a10 0x7f7cc41bc040 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:45:19.949 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.944+0000 7f7cc90d7700 1 -- 172.21.15.57:0/2107722132 >> 172.21.15.57:0/2107722132 conn(0x7f7cc408a3c0 msgr2=0x7f7cc412cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:45:19.949 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.944+0000 7f7cc90d7700 1 -- 172.21.15.57:0/2107722132 shutdown_connections 2023-03-03T07:45:19.950 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:45:19.944+0000 7f7cc90d7700 1 -- 172.21.15.57:0/2107722132 wait complete. 2023-03-03T07:45:19.977 INFO:tasks.workunit.client.0.smithi057.stdout:OK 2023-03-03T07:45:19.977 INFO:tasks.workunit.client.0.smithi057.stderr:+ echo OK 2023-03-03T07:45:19.980 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-03-03T07:45:19.981 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-03-03T07:45:20.033 INFO:tasks.workunit:Stopping ['fs/full/subvolume_rm.sh'] on client.0... 2023-03-03T07:45:20.034 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-03-03T07:45:21.241 DEBUG:teuthology.parallel:result is None 2023-03-03T07:45:21.242 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-03-03T07:45:21.297 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-03-03T07:45:21.298 INFO:teuthology.run_tasks:Running task workunit... 2023-03-03T07:45:21.369 INFO:tasks.workunit:Pulling workunits from ref 472aaef4ec3b3a2c29f73ca67854785a910f1f9b 2023-03-03T07:45:21.370 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-03-03T07:45:21.370 DEBUG:teuthology.orchestra.run.smithi057:> stat -- /home/ubuntu/cephtest/mnt.0 2023-03-03T07:45:21.415 INFO:teuthology.orchestra.run.smithi057.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-03-03T07:45:21.415 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2023-03-03T07:45:21.416 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 30h/48d Inode: 1 Links: 3 2023-03-03T07:45:21.416 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-03T07:45:21.416 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-03-03T07:45:21.416 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2023-03-03 07:45:21.288704058 +0000 2023-03-03T07:45:21.417 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2023-03-03 07:45:21.288704058 +0000 2023-03-03T07:45:21.417 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: - 2023-03-03T07:45:21.417 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-03-03T07:45:21.418 DEBUG:teuthology.orchestra.run.smithi057:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-03-03T07:45:21.516 INFO:tasks.workunit:timeout=3h 2023-03-03T07:45:21.516 INFO:tasks.workunit:cleanup=True 2023-03-03T07:45:21.517 DEBUG:teuthology.orchestra.run.smithi057:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 472aaef4ec3b3a2c29f73ca67854785a910f1f9b 2023-03-03T07:45:21.549 INFO:tasks.workunit.client.0.smithi057.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-03-03T07:45:34.142 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:46:04.219 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:46:19.272 INFO:tasks.workunit.client.0.smithi057.stderr:Updating files: 57% (6682/11620) Updating files: 58% (6740/11620) Updating files: 59% (6856/11620) Updating files: 60% (6972/11620) Updating files: 61% (7089/11620) Updating files: 62% (7205/11620) Updating files: 63% (7321/11620) Updating files: 64% (7437/11620) Updating files: 65% (7553/11620) Updating files: 66% (7670/11620) Updating files: 67% (7786/11620) Updating files: 68% (7902/11620) Updating files: 69% (8018/11620) Updating files: 70% (8134/11620) Updating files: 71% (8251/11620) Updating files: 72% (8367/11620) Updating files: 73% (8483/11620) Updating files: 74% (8599/11620) Updating files: 75% (8715/11620) Updating files: 76% (8832/11620) Updating files: 77% (8948/11620) Updating files: 78% (9064/11620) Updating files: 79% (9180/11620) Updating files: 80% (9296/11620) Updating files: 81% (9413/11620) Updating files: 82% (9529/11620) Updating files: 83% (9645/11620) Updating files: 84% (9761/11620) Updating files: 85% (9877/11620) Updating files: 86% (9994/11620) Updating files: 87% (10110/11620) Updating files: 88% (10226/11620) Updating files: 88% (10235/11620) Updating files: 89% (10342/11620) Updating files: 90% (10458/11620) Updating files: 91% (10575/11620) Updating files: 92% (10691/11620) Updating files: 93% (10807/11620) Updating files: 94% (10923/11620) Updating files: 95% (11039/11620) Updating files: 96% (11156/11620) Updating files: 97% (11272/11620) Updating files: 98% (11388/11620) Updating files: 99% (11504/11620) Updating files: 100% (11620/11620) Updating files: 100% (11620/11620), done. 2023-03-03T07:46:19.735 INFO:tasks.workunit.client.0.smithi057.stderr:Note: switching to '472aaef4ec3b3a2c29f73ca67854785a910f1f9b'. 2023-03-03T07:46:19.735 INFO:tasks.workunit.client.0.smithi057.stderr: 2023-03-03T07:46:19.735 INFO:tasks.workunit.client.0.smithi057.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-03-03T07:46:19.735 INFO:tasks.workunit.client.0.smithi057.stderr:changes and commit them, and you can discard any commits you make in this 2023-03-03T07:46:19.736 INFO:tasks.workunit.client.0.smithi057.stderr:state without impacting any branches by switching back to a branch. 2023-03-03T07:46:19.736 INFO:tasks.workunit.client.0.smithi057.stderr: 2023-03-03T07:46:19.736 INFO:tasks.workunit.client.0.smithi057.stderr:If you want to create a new branch to retain commits you create, you may 2023-03-03T07:46:19.736 INFO:tasks.workunit.client.0.smithi057.stderr:do so (now or later) by using -c with the switch command. Example: 2023-03-03T07:46:19.736 INFO:tasks.workunit.client.0.smithi057.stderr: 2023-03-03T07:46:19.736 INFO:tasks.workunit.client.0.smithi057.stderr: git switch -c 2023-03-03T07:46:19.736 INFO:tasks.workunit.client.0.smithi057.stderr: 2023-03-03T07:46:19.736 INFO:tasks.workunit.client.0.smithi057.stderr:Or undo this operation with: 2023-03-03T07:46:19.737 INFO:tasks.workunit.client.0.smithi057.stderr: 2023-03-03T07:46:19.737 INFO:tasks.workunit.client.0.smithi057.stderr: git switch - 2023-03-03T07:46:19.737 INFO:tasks.workunit.client.0.smithi057.stderr: 2023-03-03T07:46:19.737 INFO:tasks.workunit.client.0.smithi057.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-03-03T07:46:19.737 INFO:tasks.workunit.client.0.smithi057.stderr: 2023-03-03T07:46:19.737 INFO:tasks.workunit.client.0.smithi057.stderr:HEAD is now at 472aaef4ec3 Merge PR #45224 into wip-vshankar-testing-20230303.023823 2023-03-03T07:46:19.758 DEBUG:teuthology.orchestra.run.smithi057:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-03-03T07:46:19.783 INFO:tasks.workunit.client.0.smithi057.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-03-03T07:46:19.794 INFO:tasks.workunit.client.0.smithi057.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-03-03T07:46:19.795 INFO:tasks.workunit.client.0.smithi057.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-03-03T07:46:19.922 INFO:tasks.workunit.client.0.smithi057.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-03-03T07:46:20.045 INFO:tasks.workunit.client.0.smithi057.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-03-03T07:46:20.155 INFO:tasks.workunit.client.0.smithi057.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-03-03T07:46:20.162 INFO:tasks.workunit.client.0.smithi057.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-03-03T07:46:20.163 INFO:tasks.workunit.client.0.smithi057.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-03-03T07:46:20.265 INFO:tasks.workunit.client.0.smithi057.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-03-03T07:46:20.284 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-03-03T07:46:20.285 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-03-03T07:46:20.347 INFO:tasks.workunit:Running workunits matching fs/full/subvolume_clone.sh on client.0... 2023-03-03T07:46:20.348 INFO:tasks.workunit:Running workunit fs/full/subvolume_clone.sh... 2023-03-03T07:46:20.349 DEBUG:teuthology.orchestra.run.smithi057:workunit test fs/full/subvolume_clone.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=472aaef4ec3b3a2c29f73ca67854785a910f1f9b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/full/subvolume_clone.sh 2023-03-03T07:46:20.465 INFO:tasks.workunit.client.0.smithi057.stderr:+ set -e 2023-03-03T07:46:20.465 INFO:tasks.workunit.client.0.smithi057.stderr:+ NUM_CLONES=10 2023-03-03T07:46:20.466 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph fs subvolume create cephfs sub_0 2023-03-03T07:46:20.639 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:20.639+0000 7fcc12345700 1 Processor -- start 2023-03-03T07:46:20.640 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:20.639+0000 7fcc12345700 1 -- start start 2023-03-03T07:46:20.642 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:20.639+0000 7fcc12345700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcc0c12bdf0 0x7fcc0c12c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:20.642 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:20.639+0000 7fcc12345700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc0c08d490 con 0x7fcc0c08afb0 2023-03-03T07:46:20.642 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:20.639+0000 7fcc12345700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc0c12c700 con 0x7fcc0c12bdf0 2023-03-03T07:46:20.643 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:20.639+0000 7fcc11343700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcc0c12bdf0 0x7fcc0c12c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:20.643 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:20.643+0000 7fcc10b42700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fcc0c08afb0 0x7fcc0c08b410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:32904/0 (socket says 172.21.15.57:32904) 2023-03-03T07:46:20.643 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:20.643+0000 7fcc10b42700 1 -- 172.21.15.57:0/3035109774 learned_addr learned my addr 172.21.15.57:0/3035109774 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:46:20.644 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:20.643+0000 7fcc03fff700 1 -- 172.21.15.57:0/3035109774 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 684198683 0 0) 0x7fcc0c08d490 con 0x7fcc0c08afb0 2023-03-03T07:46:20.644 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:20.643+0000 7fcc03fff700 1 -- 172.21.15.57:0/3035109774 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbf80035d0 con 0x7fcc0c08afb0 2023-03-03T07:46:20.645 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:20.643+0000 7fcc11343700 1 -- 172.21.15.57:0/3035109774 >> v1:172.21.15.57:6789/0 conn(0x7fcc0c08afb0 legacy=0x7fcc0c08b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:20.645 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:20.643+0000 7fcc11343700 1 -- 172.21.15.57:0/3035109774 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc0c12b870 con 0x7fcc0c12bdf0 2023-03-03T07:46:20.645 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:20.643+0000 7fcc11343700 1 --2- 172.21.15.57:0/3035109774 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcc0c12bdf0 0x7fcc0c12c1c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fcc08009d90 tx=0x7fcc0800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b9ecb653dfd206b server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:20.646 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:20.643+0000 7fcc03fff700 1 -- 172.21.15.57:0/3035109774 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcc0800e070 con 0x7fcc0c12bdf0 2023-03-03T07:46:20.646 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:20.643+0000 7fcc03fff700 1 -- 172.21.15.57:0/3035109774 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc0800bbd0 con 0x7fcc0c12bdf0 2023-03-03T07:46:20.646 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:20.643+0000 7fcc03fff700 1 -- 172.21.15.57:0/3035109774 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcc08003a40 con 0x7fcc0c12bdf0 2023-03-03T07:46:20.647 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:20.643+0000 7fcc12345700 1 -- 172.21.15.57:0/3035109774 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcc0c12bdf0 msgr2=0x7fcc0c12c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:20.647 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:20.643+0000 7fcc12345700 1 --2- 172.21.15.57:0/3035109774 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcc0c12bdf0 0x7fcc0c12c1c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fcc08009d90 tx=0x7fcc0800b330 comp rx=0 tx=0).stop 2023-03-03T07:46:20.647 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:20.643+0000 7fcc12345700 1 -- 172.21.15.57:0/3035109774 shutdown_connections 2023-03-03T07:46:20.647 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:20.643+0000 7fcc12345700 1 --2- 172.21.15.57:0/3035109774 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcc0c12bdf0 0x7fcc0c12c1c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:20.647 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:20.643+0000 7fcc12345700 1 -- 172.21.15.57:0/3035109774 >> 172.21.15.57:0/3035109774 conn(0x7fcc0c094b00 msgr2=0x7fcc0c094ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:46:20.648 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:20.647+0000 7fcc12345700 1 -- 172.21.15.57:0/3035109774 shutdown_connections 2023-03-03T07:46:20.648 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:20.647+0000 7fcc12345700 1 -- 172.21.15.57:0/3035109774 wait complete. 2023-03-03T07:46:20.651 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:20.647+0000 7fcc12345700 1 Processor -- start 2023-03-03T07:46:20.651 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:20.651+0000 7fcc12345700 1 -- start start 2023-03-03T07:46:20.652 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:20.651+0000 7fcc12345700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcc0c08afb0 0x7fcc0c070da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:20.652 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:20.651+0000 7fcc12345700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0c070710 con 0x7fcc0c08afb0 2023-03-03T07:46:20.653 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:20.651+0000 7fcc11343700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcc0c08afb0 0x7fcc0c070da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:20.653 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:20.651+0000 7fcc11343700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcc0c08afb0 0x7fcc0c070da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34086/0 (socket says 172.21.15.57:34086) 2023-03-03T07:46:20.653 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:20.651+0000 7fcc11343700 1 -- 172.21.15.57:0/3464536697 learned_addr learned my addr 172.21.15.57:0/3464536697 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:46:20.654 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:20.651+0000 7fcc11343700 1 -- 172.21.15.57:0/3464536697 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc08009a70 con 0x7fcc0c08afb0 2023-03-03T07:46:20.654 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:20.651+0000 7fcc11343700 1 --2- 172.21.15.57:0/3464536697 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcc0c08afb0 0x7fcc0c070da0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fcc0800b370 tx=0x7fcc08004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:20.655 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:20.651+0000 7fcc01ffb700 1 -- 172.21.15.57:0/3464536697 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcc08012430 con 0x7fcc0c08afb0 2023-03-03T07:46:20.655 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:20.651+0000 7fcc01ffb700 1 -- 172.21.15.57:0/3464536697 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc080125b0 con 0x7fcc0c08afb0 2023-03-03T07:46:20.655 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:20.655+0000 7fcc01ffb700 1 -- 172.21.15.57:0/3464536697 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcc08012890 con 0x7fcc0c08afb0 2023-03-03T07:46:20.655 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:20.655+0000 7fcc12345700 1 -- 172.21.15.57:0/3464536697 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc0c131ba0 con 0x7fcc0c08afb0 2023-03-03T07:46:20.656 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:20.655+0000 7fcc12345700 1 -- 172.21.15.57:0/3464536697 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc0c08bd30 con 0x7fcc0c08afb0 2023-03-03T07:46:20.657 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:20.655+0000 7fcc12345700 1 -- 172.21.15.57:0/3464536697 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc0c131d30 con 0x7fcc0c08afb0 2023-03-03T07:46:20.657 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:20.655+0000 7fcc01ffb700 1 -- 172.21.15.57:0/3464536697 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 7) v1 ==== 42325+0+0 (secure 0 0 0) 0x7fcc080129f0 con 0x7fcc0c08afb0 2023-03-03T07:46:20.658 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:20.655+0000 7fcc01ffb700 1 --2- 172.21.15.57:0/3464536697 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fcbf0034900 0x7fcbf0036db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:20.659 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:20.655+0000 7fcc01ffb700 1 -- 172.21.15.57:0/3464536697 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 2928+0+0 (secure 0 0 0) 0x7fcc08048a60 con 0x7fcc0c08afb0 2023-03-03T07:46:20.659 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:20.659+0000 7fcc10b42700 1 --2- 172.21.15.57:0/3464536697 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fcbf0034900 0x7fcbf0036db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:20.660 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:20.659+0000 7fcc10b42700 1 --2- 172.21.15.57:0/3464536697 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fcbf0034900 0x7fcbf0036db0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc0016d0 tx=0x7fcbfc007a20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:20.666 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:20.663+0000 7fcc01ffb700 1 -- 172.21.15.57:0/3464536697 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fcc08012c80 con 0x7fcc0c08afb0 2023-03-03T07:46:20.913 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:20.911+0000 7fcc12345700 1 -- 172.21.15.57:0/3464536697 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sub_0", "target": ["mon-mgr", ""]}) v1 -- 0x7fcc0c070850 con 0x7fcbf0034900 2023-03-03T07:46:20.920 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:46:20.919+0000 7fde62304700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-03T07:46:20.920 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:46:20.919+0000 7fde62304700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-03T07:46:20.920 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:46:20.919+0000 7fde62304700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-03T07:46:20.920 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:46:20.919+0000 7fde62304700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-03T07:46:20.920 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:46:20.919+0000 7fde62304700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-03T07:46:20.964 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:20.963+0000 7fcc01ffb700 1 -- 172.21.15.57:0/3464536697 <== mgr.4099 v2:172.21.15.57:6808/28565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fcc0c070850 con 0x7fcbf0034900 2023-03-03T07:46:21.094 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:21.091+0000 7fcc12345700 1 -- 172.21.15.57:0/3464536697 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 1: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sub_0", "target": ["mon-mgr", ""]}) v1 -- 0x7fcc0c0619b0 con 0x7fcbf0034900 2023-03-03T07:46:21.110 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:21.107+0000 7fcc01ffb700 1 -- 172.21.15.57:0/3464536697 <== mgr.4099 v2:172.21.15.57:6808/28565 2 ==== mgr_command_reply(tid 1: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fcc0c0619b0 con 0x7fcbf0034900 2023-03-03T07:46:21.116 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:21.115+0000 7fcc12345700 1 -- 172.21.15.57:0/3464536697 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fcbf0034900 msgr2=0x7fcbf0036db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:21.116 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:21.115+0000 7fcc12345700 1 --2- 172.21.15.57:0/3464536697 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fcbf0034900 0x7fcbf0036db0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc0016d0 tx=0x7fcbfc007a20 comp rx=0 tx=0).stop 2023-03-03T07:46:21.116 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:21.115+0000 7fcc12345700 1 -- 172.21.15.57:0/3464536697 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcc0c08afb0 msgr2=0x7fcc0c070da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:21.116 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:21.115+0000 7fcc12345700 1 --2- 172.21.15.57:0/3464536697 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcc0c08afb0 0x7fcc0c070da0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fcc0800b370 tx=0x7fcc08004af0 comp rx=0 tx=0).stop 2023-03-03T07:46:21.117 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:21.115+0000 7fcc12345700 1 -- 172.21.15.57:0/3464536697 shutdown_connections 2023-03-03T07:46:21.117 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:21.115+0000 7fcc12345700 1 --2- 172.21.15.57:0/3464536697 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fcbf0034900 0x7fcbf0036db0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:21.117 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:21.115+0000 7fcc12345700 1 --2- 172.21.15.57:0/3464536697 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcc0c08afb0 0x7fcc0c070da0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:21.117 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:21.115+0000 7fcc12345700 1 -- 172.21.15.57:0/3464536697 >> 172.21.15.57:0/3464536697 conn(0x7fcc0c094b00 msgr2=0x7fcc0c0911c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:46:21.117 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:21.115+0000 7fcc12345700 1 -- 172.21.15.57:0/3464536697 shutdown_connections 2023-03-03T07:46:21.118 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:21.115+0000 7fcc12345700 1 -- 172.21.15.57:0/3464536697 wait complete. 2023-03-03T07:46:21.145 INFO:tasks.workunit.client.0.smithi057.stderr:++ ceph fs subvolume getpath cephfs sub_0 2023-03-03T07:46:21.733 INFO:tasks.workunit.client.0.smithi057.stderr:+ subvol_path_0=/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012 2023-03-03T07:46:21.733 INFO:tasks.workunit.client.0.smithi057.stdout:Before ratios are set 2023-03-03T07:46:21.734 INFO:tasks.workunit.client.0.smithi057.stderr:+ echo 'Before ratios are set' 2023-03-03T07:46:21.734 INFO:tasks.workunit.client.0.smithi057.stderr:+ df /home/ubuntu/cephtest/mnt.0 2023-03-03T07:46:21.742 INFO:tasks.workunit.client.0.smithi057.stdout:Filesystem 1K-blocks Used Available Use% Mounted on 2023-03-03T07:46:21.742 INFO:tasks.workunit.client.0.smithi057.stdout:ceph-fuse 978944 0 978944 0% /home/ubuntu/cephtest/mnt.0 2023-03-03T07:46:21.743 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph osd df 2023-03-03T07:46:21.910 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:21.907+0000 7f724ea2d700 1 Processor -- start 2023-03-03T07:46:21.911 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:21.907+0000 7f724ea2d700 1 -- start start 2023-03-03T07:46:21.912 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:21.911+0000 7f724ea2d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7248069da0 0x7f724808afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:21.912 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:21.911+0000 7f724ea2d700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7248071ca0 con 0x7f724808b4f0 2023-03-03T07:46:21.913 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:21.911+0000 7f724ea2d700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f724808d490 con 0x7f7248069da0 2023-03-03T07:46:21.913 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:21.911+0000 7f724da2b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7248069da0 0x7f724808afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:21.913 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:21.911+0000 7f724da2b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7248069da0 0x7f724808afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34136/0 (socket says 172.21.15.57:34136) 2023-03-03T07:46:21.913 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:21.911+0000 7f724da2b700 1 -- 172.21.15.57:0/4178832315 learned_addr learned my addr 172.21.15.57:0/4178832315 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:46:21.914 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:21.911+0000 7f724da2b700 1 -- 172.21.15.57:0/4178832315 >> v1:172.21.15.57:6789/0 conn(0x7f724808b4f0 legacy=0x7f72481290c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:21.914 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:21.911+0000 7f724da2b700 1 -- 172.21.15.57:0/4178832315 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f724808c5c0 con 0x7f7248069da0 2023-03-03T07:46:21.914 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:21.911+0000 7f724da2b700 1 --2- 172.21.15.57:0/4178832315 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7248069da0 0x7f724808afb0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7244009890 tx=0x7f7244009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2f2e66e8624f2c8 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:21.914 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:21.911+0000 7f724ca29700 1 -- 172.21.15.57:0/4178832315 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7244004160 con 0x7f7248069da0 2023-03-03T07:46:21.915 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:21.911+0000 7f724ca29700 1 -- 172.21.15.57:0/4178832315 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72440042c0 con 0x7f7248069da0 2023-03-03T07:46:21.915 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:21.911+0000 7f724ca29700 1 -- 172.21.15.57:0/4178832315 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7244004580 con 0x7f7248069da0 2023-03-03T07:46:21.915 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:21.915+0000 7f724ea2d700 1 -- 172.21.15.57:0/4178832315 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7248069da0 msgr2=0x7f724808afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:21.916 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:21.915+0000 7f724ea2d700 1 --2- 172.21.15.57:0/4178832315 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7248069da0 0x7f724808afb0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7244009890 tx=0x7f7244009ba0 comp rx=0 tx=0).stop 2023-03-03T07:46:21.916 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:21.915+0000 7f724ea2d700 1 -- 172.21.15.57:0/4178832315 shutdown_connections 2023-03-03T07:46:21.916 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:21.915+0000 7f724ea2d700 1 --2- 172.21.15.57:0/4178832315 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7248069da0 0x7f724808afb0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:21.916 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:21.915+0000 7f724ea2d700 1 -- 172.21.15.57:0/4178832315 >> 172.21.15.57:0/4178832315 conn(0x7f72480943e0 msgr2=0x7f7248095e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:46:21.917 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:21.915+0000 7f724ea2d700 1 -- 172.21.15.57:0/4178832315 shutdown_connections 2023-03-03T07:46:21.917 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:21.915+0000 7f724ea2d700 1 -- 172.21.15.57:0/4178832315 wait complete. 2023-03-03T07:46:21.919 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:21.919+0000 7f724ea2d700 1 Processor -- start 2023-03-03T07:46:21.920 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:21.919+0000 7f724ea2d700 1 -- start start 2023-03-03T07:46:21.921 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:21.919+0000 7f724ea2d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7248069da0 0x7f7248121410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:21.921 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:21.919+0000 7f724ea2d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7248123140 con 0x7f7248069da0 2023-03-03T07:46:21.922 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:21.919+0000 7f724da2b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7248069da0 0x7f7248121410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:21.922 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:21.919+0000 7f724da2b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7248069da0 0x7f7248121410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34142/0 (socket says 172.21.15.57:34142) 2023-03-03T07:46:21.922 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:21.919+0000 7f724da2b700 1 -- 172.21.15.57:0/945991788 learned_addr learned my addr 172.21.15.57:0/945991788 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:46:21.922 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:21.919+0000 7f724da2b700 1 -- 172.21.15.57:0/945991788 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7244009570 con 0x7f7248069da0 2023-03-03T07:46:21.923 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:21.923+0000 7f724da2b700 1 --2- 172.21.15.57:0/945991788 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7248069da0 0x7f7248121410 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7244009fd0 tx=0x7f7244004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:21.924 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:21.923+0000 7f723e7fc700 1 -- 172.21.15.57:0/945991788 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f724400b670 con 0x7f7248069da0 2023-03-03T07:46:21.924 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:21.923+0000 7f723e7fc700 1 -- 172.21.15.57:0/945991788 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f724400b7d0 con 0x7f7248069da0 2023-03-03T07:46:21.924 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:21.923+0000 7f723e7fc700 1 -- 172.21.15.57:0/945991788 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f724400ba70 con 0x7f7248069da0 2023-03-03T07:46:21.924 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:21.923+0000 7f724ea2d700 1 -- 172.21.15.57:0/945991788 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f724808bd40 con 0x7f7248069da0 2023-03-03T07:46:21.925 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:21.923+0000 7f724ea2d700 1 -- 172.21.15.57:0/945991788 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f724808bbb0 con 0x7f7248069da0 2023-03-03T07:46:21.926 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:21.923+0000 7f724ea2d700 1 -- 172.21.15.57:0/945991788 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7248123f90 con 0x7f7248069da0 2023-03-03T07:46:21.926 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:21.923+0000 7f723e7fc700 1 -- 172.21.15.57:0/945991788 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 7) v1 ==== 42325+0+0 (secure 0 0 0) 0x7f7244017020 con 0x7f7248069da0 2023-03-03T07:46:21.928 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:21.927+0000 7f723e7fc700 1 --2- 172.21.15.57:0/945991788 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f722c034960 0x7f722c036e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:21.928 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:21.927+0000 7f723e7fc700 1 -- 172.21.15.57:0/945991788 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 2928+0+0 (secure 0 0 0) 0x7f7244047c20 con 0x7f7248069da0 2023-03-03T07:46:21.928 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:21.927+0000 7f724d22a700 1 --2- 172.21.15.57:0/945991788 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f722c034960 0x7f722c036e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:21.929 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:21.927+0000 7f724d22a700 1 --2- 172.21.15.57:0/945991788 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f722c034960 0x7f722c036e10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f724808c480 tx=0x7f7238007b00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:21.933 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:21.931+0000 7f723e7fc700 1 -- 172.21.15.57:0/945991788 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f724400bbd0 con 0x7f7248069da0 2023-03-03T07:46:22.106 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:22.103+0000 7f724ea2d700 1 -- 172.21.15.57:0/945991788 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 0: {"prefix": "osd df", "target": ["mon-mgr", ""]}) v1 -- 0x7f7248122f20 con 0x7f722c034960 2023-03-03T07:46:22.107 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:22.103+0000 7f723e7fc700 1 -- 172.21.15.57:0/945991788 <== mgr.4099 v2:172.21.15.57:6808/28565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+343 (secure 0 0 0) 0x7f7248122f20 con 0x7f722c034960 2023-03-03T07:46:22.208 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:22.207+0000 7f724ea2d700 1 -- 172.21.15.57:0/945991788 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 1: {"prefix": "osd df", "target": ["mon-mgr", ""]}) v1 -- 0x7f724804e230 con 0x7f722c034960 2023-03-03T07:46:22.208 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:22.207+0000 7f723e7fc700 1 -- 172.21.15.57:0/945991788 <== mgr.4099 v2:172.21.15.57:6808/28565 2 ==== mgr_command_reply(tid 1: 0 ) v1 ==== 8+0+343 (secure 0 0 0) 0x7f724804e230 con 0x7f722c034960 2023-03-03T07:46:22.209 INFO:tasks.workunit.client.0.smithi057.stdout:ID CLASS WEIGHT REWEIGHT SIZE RAW USE DATA OMAP META AVAIL %USE VAR PGS STATUS 2023-03-03T07:46:22.209 INFO:tasks.workunit.client.0.smithi057.stdout: 0 ssd 0.00099 1.00000 1 GiB 15 MiB 992 KiB 0 B 14 MiB 1009 MiB 1.45 1.00 105 up 2023-03-03T07:46:22.209 INFO:tasks.workunit.client.0.smithi057.stdout: TOTAL 1 GiB 15 MiB 992 KiB 0 B 14 MiB 1009 MiB 1.45 2023-03-03T07:46:22.209 INFO:tasks.workunit.client.0.smithi057.stdout:MIN/MAX VAR: 1.00/1.00 STDDEV: 0 2023-03-03T07:46:22.211 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:22.211+0000 7f724ea2d700 1 -- 172.21.15.57:0/945991788 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f722c034960 msgr2=0x7f722c036e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:22.211 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:22.211+0000 7f724ea2d700 1 --2- 172.21.15.57:0/945991788 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f722c034960 0x7f722c036e10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f724808c480 tx=0x7f7238007b00 comp rx=0 tx=0).stop 2023-03-03T07:46:22.212 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:22.211+0000 7f724ea2d700 1 -- 172.21.15.57:0/945991788 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7248069da0 msgr2=0x7f7248121410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:22.212 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:22.211+0000 7f724ea2d700 1 --2- 172.21.15.57:0/945991788 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7248069da0 0x7f7248121410 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7244009fd0 tx=0x7f7244004770 comp rx=0 tx=0).stop 2023-03-03T07:46:22.212 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:22.211+0000 7f724ea2d700 1 -- 172.21.15.57:0/945991788 shutdown_connections 2023-03-03T07:46:22.212 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:22.211+0000 7f724ea2d700 1 --2- 172.21.15.57:0/945991788 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f722c034960 0x7f722c036e10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:22.212 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:22.211+0000 7f724ea2d700 1 --2- 172.21.15.57:0/945991788 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7248069da0 0x7f7248121410 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:22.213 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:22.211+0000 7f724ea2d700 1 -- 172.21.15.57:0/945991788 >> 172.21.15.57:0/945991788 conn(0x7f72480943e0 msgr2=0x7f7248090200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:46:22.213 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:22.211+0000 7f724ea2d700 1 -- 172.21.15.57:0/945991788 shutdown_connections 2023-03-03T07:46:22.213 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:22.211+0000 7f724ea2d700 1 -- 172.21.15.57:0/945991788 wait complete. 2023-03-03T07:46:22.235 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph osd set-full-ratio 0.6 2023-03-03T07:46:22.397 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:22.395+0000 7f5003253700 1 Processor -- start 2023-03-03T07:46:22.397 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:22.395+0000 7f5003253700 1 -- start start 2023-03-03T07:46:22.398 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:22.395+0000 7f5003253700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4ffc069da0 0x7f4ffc08b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:22.398 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:22.395+0000 7f5003253700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ffc071ca0 con 0x7f4ffc125fa0 2023-03-03T07:46:22.398 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:22.395+0000 7f5003253700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ffc08bd80 con 0x7f4ffc069da0 2023-03-03T07:46:22.399 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:22.395+0000 7f5002251700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4ffc069da0 0x7f4ffc08b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:22.399 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:22.395+0000 7f5001a50700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f4ffc125fa0 0x7f4ffc128380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:32928/0 (socket says 172.21.15.57:32928) 2023-03-03T07:46:22.399 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:22.395+0000 7f5001a50700 1 -- 172.21.15.57:0/2020448414 learned_addr learned my addr 172.21.15.57:0/2020448414 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:46:22.400 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:22.399+0000 7f500124f700 1 -- 172.21.15.57:0/2020448414 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 445896875 0 0) 0x7f4ffc071ca0 con 0x7f4ffc125fa0 2023-03-03T07:46:22.400 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:22.399+0000 7f500124f700 1 -- 172.21.15.57:0/2020448414 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fe80035d0 con 0x7f4ffc125fa0 2023-03-03T07:46:22.400 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:22.399+0000 7f5002251700 1 -- 172.21.15.57:0/2020448414 >> v1:172.21.15.57:6789/0 conn(0x7f4ffc125fa0 legacy=0x7f4ffc128380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:22.400 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:22.399+0000 7f5002251700 1 -- 172.21.15.57:0/2020448414 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ffc08d490 con 0x7f4ffc069da0 2023-03-03T07:46:22.401 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:22.399+0000 7f5002251700 1 --2- 172.21.15.57:0/2020448414 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ffc069da0 0x7f4ffc08b840 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4ff800a970 tx=0x7f4ff800ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72a77692d6173d58 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:22.401 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:22.399+0000 7f500124f700 1 -- 172.21.15.57:0/2020448414 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ff8004160 con 0x7f4ffc069da0 2023-03-03T07:46:22.402 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:22.399+0000 7f500124f700 1 -- 172.21.15.57:0/2020448414 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff80042c0 con 0x7f4ffc069da0 2023-03-03T07:46:22.402 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:22.399+0000 7f500124f700 1 -- 172.21.15.57:0/2020448414 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ff8004560 con 0x7f4ffc069da0 2023-03-03T07:46:22.402 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:22.399+0000 7f5003253700 1 -- 172.21.15.57:0/2020448414 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ffc069da0 msgr2=0x7f4ffc08b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:22.402 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:22.399+0000 7f5003253700 1 --2- 172.21.15.57:0/2020448414 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ffc069da0 0x7f4ffc08b840 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4ff800a970 tx=0x7f4ff800ac80 comp rx=0 tx=0).stop 2023-03-03T07:46:22.404 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:22.403+0000 7f5003253700 1 -- 172.21.15.57:0/2020448414 shutdown_connections 2023-03-03T07:46:22.404 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:22.403+0000 7f5003253700 1 --2- 172.21.15.57:0/2020448414 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ffc069da0 0x7f4ffc08b840 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:22.404 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:22.403+0000 7f5003253700 1 -- 172.21.15.57:0/2020448414 >> 172.21.15.57:0/2020448414 conn(0x7f4ffc0943e0 msgr2=0x7f4ffc095e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:46:22.405 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:22.403+0000 7f5003253700 1 -- 172.21.15.57:0/2020448414 shutdown_connections 2023-03-03T07:46:22.405 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:22.403+0000 7f5003253700 1 -- 172.21.15.57:0/2020448414 wait complete. 2023-03-03T07:46:22.406 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:22.403+0000 7f5003253700 1 Processor -- start 2023-03-03T07:46:22.407 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:22.403+0000 7f5003253700 1 -- start start 2023-03-03T07:46:22.407 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:22.407+0000 7f5003253700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ffc069da0 0x7f4ffc120fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:22.408 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:22.407+0000 7f5003253700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ffc123bc0 con 0x7f4ffc069da0 2023-03-03T07:46:22.408 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:22.407+0000 7f5002251700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ffc069da0 0x7f4ffc120fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:22.408 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:22.407+0000 7f5002251700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ffc069da0 0x7f4ffc120fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34164/0 (socket says 172.21.15.57:34164) 2023-03-03T07:46:22.408 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:22.407+0000 7f5002251700 1 -- 172.21.15.57:0/2147782494 learned_addr learned my addr 172.21.15.57:0/2147782494 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:46:22.409 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:22.407+0000 7f5002251700 1 -- 172.21.15.57:0/2147782494 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff800a650 con 0x7f4ffc069da0 2023-03-03T07:46:22.409 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:22.407+0000 7f5002251700 1 --2- 172.21.15.57:0/2147782494 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ffc069da0 0x7f4ffc120fe0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4ff800afd0 tx=0x7f4ff8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:22.410 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:22.407+0000 7f4ff2ffd700 1 -- 172.21.15.57:0/2147782494 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ff801d070 con 0x7f4ffc069da0 2023-03-03T07:46:22.410 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:22.407+0000 7f4ff2ffd700 1 -- 172.21.15.57:0/2147782494 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff80037f0 con 0x7f4ffc069da0 2023-03-03T07:46:22.410 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:22.407+0000 7f5003253700 1 -- 172.21.15.57:0/2147782494 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ffc08b140 con 0x7f4ffc069da0 2023-03-03T07:46:22.410 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:22.407+0000 7f4ff2ffd700 1 -- 172.21.15.57:0/2147782494 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ff8003ad0 con 0x7f4ffc069da0 2023-03-03T07:46:22.411 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:22.407+0000 7f5003253700 1 -- 172.21.15.57:0/2147782494 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ffc08afb0 con 0x7f4ffc069da0 2023-03-03T07:46:22.412 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:22.411+0000 7f4ff2ffd700 1 -- 172.21.15.57:0/2147782494 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 7) v1 ==== 42325+0+0 (secure 0 0 0) 0x7f4ff8028030 con 0x7f4ffc069da0 2023-03-03T07:46:22.412 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:22.411+0000 7f5003253700 1 -- 172.21.15.57:0/2147782494 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ffc08b2d0 con 0x7f4ffc069da0 2023-03-03T07:46:22.413 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:22.411+0000 7f4ff2ffd700 1 --2- 172.21.15.57:0/2147782494 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f4fe0034910 0x7f4fe0036dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:22.413 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:22.411+0000 7f4ff2ffd700 1 -- 172.21.15.57:0/2147782494 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 2928+0+0 (secure 0 0 0) 0x7f4ff80476c0 con 0x7f4ffc069da0 2023-03-03T07:46:22.413 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:22.411+0000 7f5001a50700 1 --2- 172.21.15.57:0/2147782494 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f4fe0034910 0x7f4fe0036dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:22.414 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:22.411+0000 7f5001a50700 1 --2- 172.21.15.57:0/2147782494 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f4fe0034910 0x7f4fe0036dc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4fec0010e0 tx=0x7f4fec007a20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:22.420 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:22.419+0000 7f4ff2ffd700 1 -- 172.21.15.57:0/2147782494 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4ff800f7e0 con 0x7f4ffc069da0 2023-03-03T07:46:22.603 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:22.599+0000 7f5003253700 1 -- 172.21.15.57:0/2147782494 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd set-full-ratio", "ratio": 0.6} v 0) v1 -- 0x7f4ffc0619b0 con 0x7f4ffc069da0 2023-03-03T07:46:23.383 INFO:tasks.ceph.mon.a.smithi057.stderr:2023-03-03T07:46:23.379+0000 7fcc0ddf9700 -1 log_channel(cluster) log [ERR] : Health check failed: full ratio(s) out of order (OSD_OUT_OF_ORDER_FULL) 2023-03-03T07:46:23.397 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:23.395+0000 7f4ff2ffd700 1 -- 172.21.15.57:0/2147782494 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mgrmap(e 8) v1 ==== 42245+0+0 (secure 0 0 0) 0x7f4ff800e040 con 0x7f4ffc069da0 2023-03-03T07:46:23.398 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:23.395+0000 7f4ff2ffd700 1 -- 172.21.15.57:0/2147782494 <== mon.0 v2:172.21.15.57:3300/0 8 ==== mon_command_ack([{"prefix": "osd set-full-ratio", "ratio": 0.6}]=0 osd set-full-ratio 0.6 v30) v1 ==== 102+0+0 (secure 0 0 0) 0x7f4ff802aa10 con 0x7f4ffc069da0 2023-03-03T07:46:23.505 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:23.503+0000 7f5003253700 1 -- 172.21.15.57:0/2147782494 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd set-full-ratio", "ratio": 0.6} v 0) v1 -- 0x7f4ffc072140 con 0x7f4ffc069da0 2023-03-03T07:46:24.404 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:24.402+0000 7f4ff2ffd700 1 -- 172.21.15.57:0/2147782494 <== mon.0 v2:172.21.15.57:3300/0 9 ==== mon_command_ack([{"prefix": "osd set-full-ratio", "ratio": 0.6}]=0 osd set-full-ratio 0.6 v31) v1 ==== 102+0+0 (secure 0 0 0) 0x7f4ff80490e0 con 0x7f4ffc069da0 2023-03-03T07:46:24.410 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:24.406+0000 7f5003253700 1 -- 172.21.15.57:0/2147782494 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f4fe0034910 msgr2=0x7f4fe0036dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:24.410 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:24.406+0000 7f5003253700 1 --2- 172.21.15.57:0/2147782494 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f4fe0034910 0x7f4fe0036dc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4fec0010e0 tx=0x7f4fec007a20 comp rx=0 tx=0).stop 2023-03-03T07:46:24.410 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:24.406+0000 7f5003253700 1 -- 172.21.15.57:0/2147782494 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ffc069da0 msgr2=0x7f4ffc120fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:24.411 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:24.406+0000 7f5003253700 1 --2- 172.21.15.57:0/2147782494 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ffc069da0 0x7f4ffc120fe0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4ff800afd0 tx=0x7f4ff8004770 comp rx=0 tx=0).stop 2023-03-03T07:46:24.411 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:24.406+0000 7f5003253700 1 -- 172.21.15.57:0/2147782494 shutdown_connections 2023-03-03T07:46:24.411 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:24.406+0000 7f5003253700 1 --2- 172.21.15.57:0/2147782494 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f4fe0034910 0x7f4fe0036dc0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:24.411 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:24.406+0000 7f5003253700 1 --2- 172.21.15.57:0/2147782494 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ffc069da0 0x7f4ffc120fe0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:24.411 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:24.406+0000 7f5003253700 1 -- 172.21.15.57:0/2147782494 >> 172.21.15.57:0/2147782494 conn(0x7f4ffc0943e0 msgr2=0x7f4ffc090f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:46:24.411 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:24.406+0000 7f5003253700 1 -- 172.21.15.57:0/2147782494 shutdown_connections 2023-03-03T07:46:24.412 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:24.406+0000 7f5003253700 1 -- 172.21.15.57:0/2147782494 wait complete. 2023-03-03T07:46:24.412 INFO:tasks.workunit.client.0.smithi057.stderr:osd set-full-ratio 0.6 2023-03-03T07:46:24.436 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph osd set-nearfull-ratio 0.50 2023-03-03T07:46:24.606 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:24.602+0000 7fc0cb59e700 1 Processor -- start 2023-03-03T07:46:24.606 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:24.602+0000 7fc0cb59e700 1 -- start start 2023-03-03T07:46:24.608 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:24.606+0000 7fc0cb59e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc0cc091de0 0x7fc0cc08ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:24.608 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:24.606+0000 7fc0cb59e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0cc0911f0 con 0x7fc0cc091a10 2023-03-03T07:46:24.608 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:24.606+0000 7fc0cb59e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0cc0662f0 con 0x7fc0cc091de0 2023-03-03T07:46:24.609 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:24.606+0000 7fc0ca59c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc0cc091a10 0x7fc0cc08e730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:32944/0 (socket says 172.21.15.57:32944) 2023-03-03T07:46:24.609 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:24.606+0000 7fc0ca59c700 1 -- 172.21.15.57:0/3759564835 learned_addr learned my addr 172.21.15.57:0/3759564835 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:46:24.609 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:24.606+0000 7fc0c1d9b700 1 --2- 172.21.15.57:0/3759564835 >> v2:172.21.15.57:3300/0 conn(0x7fc0cc091de0 0x7fc0cc08ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:24.610 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:24.606+0000 7fc0c9d9b700 1 -- 172.21.15.57:0/3759564835 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3976511971 0 0) 0x7fc0cc0911f0 con 0x7fc0cc091a10 2023-03-03T07:46:24.610 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:24.606+0000 7fc0c1d9b700 1 -- 172.21.15.57:0/3759564835 >> v1:172.21.15.57:6789/0 conn(0x7fc0cc091a10 legacy=0x7fc0cc08e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:24.610 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:24.606+0000 7fc0c1d9b700 1 -- 172.21.15.57:0/3759564835 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0cc066700 con 0x7fc0cc091de0 2023-03-03T07:46:24.611 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:24.610+0000 7fc0c1d9b700 1 --2- 172.21.15.57:0/3759564835 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0cc091de0 0x7fc0cc08ee40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc0b40097d0 tx=0x7fc0b4009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2eada07e578e99f server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:24.612 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:24.610+0000 7fc0c9d9b700 1 -- 172.21.15.57:0/3759564835 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0b40041c0 con 0x7fc0cc091de0 2023-03-03T07:46:24.612 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:24.610+0000 7fc0c9d9b700 1 -- 172.21.15.57:0/3759564835 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b4004320 con 0x7fc0cc091de0 2023-03-03T07:46:24.612 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:24.610+0000 7fc0c9d9b700 1 -- 172.21.15.57:0/3759564835 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0b40036c0 con 0x7fc0cc091de0 2023-03-03T07:46:24.613 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:24.610+0000 7fc0cb59e700 1 -- 172.21.15.57:0/3759564835 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0cc091de0 msgr2=0x7fc0cc08ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:24.613 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:24.610+0000 7fc0cb59e700 1 --2- 172.21.15.57:0/3759564835 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0cc091de0 0x7fc0cc08ee40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc0b40097d0 tx=0x7fc0b4009ae0 comp rx=0 tx=0).stop 2023-03-03T07:46:24.614 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:24.610+0000 7fc0cb59e700 1 -- 172.21.15.57:0/3759564835 shutdown_connections 2023-03-03T07:46:24.614 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:24.610+0000 7fc0cb59e700 1 --2- 172.21.15.57:0/3759564835 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0cc091de0 0x7fc0cc08ee40 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:24.614 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:24.610+0000 7fc0cb59e700 1 -- 172.21.15.57:0/3759564835 >> 172.21.15.57:0/3759564835 conn(0x7fc0cc08a3c0 msgr2=0x7fc0cc08c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:46:24.614 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:24.610+0000 7fc0cb59e700 1 -- 172.21.15.57:0/3759564835 shutdown_connections 2023-03-03T07:46:24.614 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:24.610+0000 7fc0cb59e700 1 -- 172.21.15.57:0/3759564835 wait complete. 2023-03-03T07:46:24.616 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:24.614+0000 7fc0cb59e700 1 Processor -- start 2023-03-03T07:46:24.617 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:24.614+0000 7fc0cb59e700 1 -- start start 2023-03-03T07:46:24.617 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:24.614+0000 7fc0cb59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0cc091a10 0x7fc0cc1bbe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:24.617 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:24.614+0000 7fc0cb59e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0cc11ea40 con 0x7fc0cc091a10 2023-03-03T07:46:24.618 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:24.614+0000 7fc0ca59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0cc091a10 0x7fc0cc1bbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:24.618 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:24.614+0000 7fc0ca59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0cc091a10 0x7fc0cc1bbe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34170/0 (socket says 172.21.15.57:34170) 2023-03-03T07:46:24.618 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:24.614+0000 7fc0ca59c700 1 -- 172.21.15.57:0/2424964522 learned_addr learned my addr 172.21.15.57:0/2424964522 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:46:24.619 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:24.614+0000 7fc0ca59c700 1 -- 172.21.15.57:0/2424964522 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b40094b0 con 0x7fc0cc091a10 2023-03-03T07:46:24.619 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:24.618+0000 7fc0ca59c700 1 --2- 172.21.15.57:0/2424964522 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0cc091a10 0x7fc0cc1bbe30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc00c4d0 tx=0x7fc0bc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:24.620 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:24.618+0000 7fc0c37fe700 1 -- 172.21.15.57:0/2424964522 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0bc004bd0 con 0x7fc0cc091a10 2023-03-03T07:46:24.620 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:24.618+0000 7fc0c37fe700 1 -- 172.21.15.57:0/2424964522 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0bc004d50 con 0x7fc0cc091a10 2023-03-03T07:46:24.620 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:24.618+0000 7fc0c37fe700 1 -- 172.21.15.57:0/2424964522 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0bc0070d0 con 0x7fc0cc091a10 2023-03-03T07:46:24.620 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:24.618+0000 7fc0cb59e700 1 -- 172.21.15.57:0/2424964522 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0cc090f00 con 0x7fc0cc091a10 2023-03-03T07:46:24.620 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:24.618+0000 7fc0cb59e700 1 -- 172.21.15.57:0/2424964522 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0cc08f590 con 0x7fc0cc091a10 2023-03-03T07:46:24.621 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:24.618+0000 7fc0cb59e700 1 -- 172.21.15.57:0/2424964522 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0cc12d720 con 0x7fc0cc091a10 2023-03-03T07:46:24.622 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:24.618+0000 7fc0c37fe700 1 -- 172.21.15.57:0/2424964522 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 42245+0+0 (secure 0 0 0) 0x7fc0bc01a020 con 0x7fc0cc091a10 2023-03-03T07:46:24.623 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:24.622+0000 7fc0c37fe700 1 --2- 172.21.15.57:0/2424964522 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fc0ac034800 0x7fc0ac036cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:24.624 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:24.622+0000 7fc0c37fe700 1 -- 172.21.15.57:0/2424964522 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 2928+0+0 (secure 0 0 0) 0x7fc0bc045df0 con 0x7fc0cc091a10 2023-03-03T07:46:24.624 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:24.622+0000 7fc0c1d9b700 1 --2- 172.21.15.57:0/2424964522 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fc0ac034800 0x7fc0ac036cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:24.625 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:24.622+0000 7fc0c1d9b700 1 --2- 172.21.15.57:0/2424964522 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fc0ac034800 0x7fc0ac036cb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc0b40097d0 tx=0x7fc0b4010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:24.632 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:24.630+0000 7fc0c37fe700 1 -- 172.21.15.57:0/2424964522 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc0bc01bb70 con 0x7fc0cc091a10 2023-03-03T07:46:24.814 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:24.810+0000 7fc0cb59e700 1 -- 172.21.15.57:0/2424964522 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd set-nearfull-ratio", "ratio": 0.5} v 0) v1 -- 0x7fc0cc0619b0 con 0x7fc0cc091a10 2023-03-03T07:46:25.414 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:25.410+0000 7fc0c37fe700 1 -- 172.21.15.57:0/2424964522 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd set-nearfull-ratio", "ratio": 0.5}]=0 osd set-nearfull-ratio 0.5 v32) v1 ==== 110+0+0 (secure 0 0 0) 0x7fc0bc01b340 con 0x7fc0cc091a10 2023-03-03T07:46:25.527 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:25.522+0000 7fc0cb59e700 1 -- 172.21.15.57:0/2424964522 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd set-nearfull-ratio", "ratio": 0.5} v 0) v1 -- 0x7fc0cc11eb90 con 0x7fc0cc091a10 2023-03-03T07:46:26.431 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:26.430+0000 7fc0c37fe700 1 -- 172.21.15.57:0/2424964522 <== mon.0 v2:172.21.15.57:3300/0 8 ==== mon_command_ack([{"prefix": "osd set-nearfull-ratio", "ratio": 0.5}]=0 osd set-nearfull-ratio 0.5 v33) v1 ==== 110+0+0 (secure 0 0 0) 0x7fc0bc01b990 con 0x7fc0cc091a10 2023-03-03T07:46:26.437 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:26.434+0000 7fc0cb59e700 1 -- 172.21.15.57:0/2424964522 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fc0ac034800 msgr2=0x7fc0ac036cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:26.438 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:26.434+0000 7fc0cb59e700 1 --2- 172.21.15.57:0/2424964522 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fc0ac034800 0x7fc0ac036cb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc0b40097d0 tx=0x7fc0b4010000 comp rx=0 tx=0).stop 2023-03-03T07:46:26.438 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:26.434+0000 7fc0cb59e700 1 -- 172.21.15.57:0/2424964522 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0cc091a10 msgr2=0x7fc0cc1bbe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:26.438 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:26.434+0000 7fc0cb59e700 1 --2- 172.21.15.57:0/2424964522 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0cc091a10 0x7fc0cc1bbe30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc00c4d0 tx=0x7fc0bc00c890 comp rx=0 tx=0).stop 2023-03-03T07:46:26.438 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:26.434+0000 7fc0cb59e700 1 -- 172.21.15.57:0/2424964522 shutdown_connections 2023-03-03T07:46:26.438 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:26.434+0000 7fc0cb59e700 1 --2- 172.21.15.57:0/2424964522 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fc0ac034800 0x7fc0ac036cb0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:26.438 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:26.434+0000 7fc0cb59e700 1 --2- 172.21.15.57:0/2424964522 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0cc091a10 0x7fc0cc1bbe30 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:26.439 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:26.434+0000 7fc0cb59e700 1 -- 172.21.15.57:0/2424964522 >> 172.21.15.57:0/2424964522 conn(0x7fc0cc08a3c0 msgr2=0x7fc0cc12caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:46:26.439 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:26.434+0000 7fc0cb59e700 1 -- 172.21.15.57:0/2424964522 shutdown_connections 2023-03-03T07:46:26.439 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:26.434+0000 7fc0cb59e700 1 -- 172.21.15.57:0/2424964522 wait complete. 2023-03-03T07:46:26.440 INFO:tasks.workunit.client.0.smithi057.stderr:osd set-nearfull-ratio 0.5 2023-03-03T07:46:26.465 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph osd set-backfillfull-ratio 0.55 2023-03-03T07:46:26.634 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:26.630+0000 7f241da5a700 1 Processor -- start 2023-03-03T07:46:26.635 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:26.630+0000 7f241da5a700 1 -- start start 2023-03-03T07:46:26.636 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:26.634+0000 7f241da5a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f241808ce20 0x7f241812ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:26.636 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:26.634+0000 7f241da5a700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2418066700 con 0x7f241808c340 2023-03-03T07:46:26.637 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:26.634+0000 7f241da5a700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2418066000 con 0x7f241808ce20 2023-03-03T07:46:26.639 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:26.634+0000 7f241ca58700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f241808c340 0x7f241808c710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:32950/0 (socket says 172.21.15.57:32950) 2023-03-03T07:46:26.639 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:26.634+0000 7f241ca58700 1 -- 172.21.15.57:0/3546931613 learned_addr learned my addr 172.21.15.57:0/3546931613 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:46:26.639 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:26.634+0000 7f2417fff700 1 --2- 172.21.15.57:0/3546931613 >> v2:172.21.15.57:3300/0 conn(0x7f241808ce20 0x7f241812ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:26.640 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:26.638+0000 7f2417fff700 1 -- 172.21.15.57:0/3546931613 >> v1:172.21.15.57:6789/0 conn(0x7f241808c340 legacy=0x7f241808c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:26.640 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:26.638+0000 7f2417fff700 1 -- 172.21.15.57:0/3546931613 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f241808d860 con 0x7f241808ce20 2023-03-03T07:46:26.640 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:26.638+0000 7f2417fff700 1 --2- 172.21.15.57:0/3546931613 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f241808ce20 0x7f241812ab10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f24040097d0 tx=0x7f2404009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41f9e0c570411237 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:26.641 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:26.638+0000 7f24177fe700 1 -- 172.21.15.57:0/3546931613 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f24040041c0 con 0x7f241808ce20 2023-03-03T07:46:26.641 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:26.638+0000 7f24177fe700 1 -- 172.21.15.57:0/3546931613 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2404004320 con 0x7f241808ce20 2023-03-03T07:46:26.642 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:26.638+0000 7f24177fe700 1 -- 172.21.15.57:0/3546931613 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f24040036c0 con 0x7f241808ce20 2023-03-03T07:46:26.642 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:26.638+0000 7f241da5a700 1 -- 172.21.15.57:0/3546931613 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f241808ce20 msgr2=0x7f241812ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:26.642 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:26.638+0000 7f241da5a700 1 --2- 172.21.15.57:0/3546931613 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f241808ce20 0x7f241812ab10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f24040097d0 tx=0x7f2404009ae0 comp rx=0 tx=0).stop 2023-03-03T07:46:26.643 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:26.638+0000 7f241da5a700 1 -- 172.21.15.57:0/3546931613 shutdown_connections 2023-03-03T07:46:26.643 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:26.638+0000 7f241da5a700 1 --2- 172.21.15.57:0/3546931613 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f241808ce20 0x7f241812ab10 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:26.643 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:26.638+0000 7f241da5a700 1 -- 172.21.15.57:0/3546931613 >> 172.21.15.57:0/3546931613 conn(0x7f241806fa80 msgr2=0x7f241806fe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:46:26.643 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:26.638+0000 7f241da5a700 1 -- 172.21.15.57:0/3546931613 shutdown_connections 2023-03-03T07:46:26.644 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:26.638+0000 7f241da5a700 1 -- 172.21.15.57:0/3546931613 wait complete. 2023-03-03T07:46:26.644 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:26.642+0000 7f241da5a700 1 Processor -- start 2023-03-03T07:46:26.645 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:26.642+0000 7f241da5a700 1 -- start start 2023-03-03T07:46:26.646 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:26.642+0000 7f241da5a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f241808c340 0x7f24181c0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:26.646 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:26.642+0000 7f241da5a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2418117880 con 0x7f241808c340 2023-03-03T07:46:26.647 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:26.642+0000 7f241ca58700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f241808c340 0x7f24181c0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:26.647 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:26.642+0000 7f241ca58700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f241808c340 0x7f24181c0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34184/0 (socket says 172.21.15.57:34184) 2023-03-03T07:46:26.647 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:26.642+0000 7f241ca58700 1 -- 172.21.15.57:0/3612850995 learned_addr learned my addr 172.21.15.57:0/3612850995 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:46:26.647 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:26.646+0000 7f241ca58700 1 -- 172.21.15.57:0/3612850995 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24040094b0 con 0x7f241808c340 2023-03-03T07:46:26.649 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:26.646+0000 7f241ca58700 1 --2- 172.21.15.57:0/3612850995 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f241808c340 0x7f24181c0270 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f240c00c680 tx=0x7f240c00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:26.650 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:26.646+0000 7f24157fa700 1 -- 172.21.15.57:0/3612850995 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f240c005cc0 con 0x7f241808c340 2023-03-03T07:46:26.650 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:26.646+0000 7f24157fa700 1 -- 172.21.15.57:0/3612850995 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f240c005e20 con 0x7f241808c340 2023-03-03T07:46:26.650 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:26.646+0000 7f24157fa700 1 -- 172.21.15.57:0/3612850995 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f240c007200 con 0x7f241808c340 2023-03-03T07:46:26.650 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:26.646+0000 7f241da5a700 1 -- 172.21.15.57:0/3612850995 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f241812b3f0 con 0x7f241808c340 2023-03-03T07:46:26.650 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:26.646+0000 7f241da5a700 1 -- 172.21.15.57:0/3612850995 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f241812b260 con 0x7f241808c340 2023-03-03T07:46:26.651 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:26.646+0000 7f241da5a700 1 -- 172.21.15.57:0/3612850995 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f241812b580 con 0x7f241808c340 2023-03-03T07:46:26.651 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:26.646+0000 7f24157fa700 1 -- 172.21.15.57:0/3612850995 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 42245+0+0 (secure 0 0 0) 0x7f240c019030 con 0x7f241808c340 2023-03-03T07:46:26.652 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:26.650+0000 7f24157fa700 1 --2- 172.21.15.57:0/3612850995 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f23fc034800 0x7f23fc036cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:26.652 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:26.650+0000 7f24157fa700 1 -- 172.21.15.57:0/3612850995 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 2928+0+0 (secure 0 0 0) 0x7f240c045550 con 0x7f241808c340 2023-03-03T07:46:26.652 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:26.650+0000 7f2417fff700 1 --2- 172.21.15.57:0/3612850995 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f23fc034800 0x7f23fc036cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:26.653 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:26.650+0000 7f2417fff700 1 --2- 172.21.15.57:0/3612850995 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f23fc034800 0x7f23fc036cb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2404014040 tx=0x7f2404010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:26.659 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:26.654+0000 7f24157fa700 1 -- 172.21.15.57:0/3612850995 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f240c0198b0 con 0x7f241808c340 2023-03-03T07:46:26.844 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:26.842+0000 7f241da5a700 1 -- 172.21.15.57:0/3612850995 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd set-backfillfull-ratio", "ratio": 0.55} v 0) v1 -- 0x7f24180619b0 con 0x7f241808c340 2023-03-03T07:46:27.448 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:27.442+0000 7f24157fa700 1 -- 172.21.15.57:0/3612850995 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd set-backfillfull-ratio", "ratio": 0.55}]=0 osd set-backfillfull-ratio 0.55 v34) v1 ==== 120+0+0 (secure 0 0 0) 0x7f240c017030 con 0x7f241808c340 2023-03-03T07:46:27.558 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:27.554+0000 7f241da5a700 1 -- 172.21.15.57:0/3612850995 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd set-backfillfull-ratio", "ratio": 0.55} v 0) v1 -- 0x7f24181179d0 con 0x7f241808c340 2023-03-03T07:46:28.463 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.458+0000 7f24157fa700 1 -- 172.21.15.57:0/3612850995 <== mon.0 v2:172.21.15.57:3300/0 8 ==== mon_command_ack([{"prefix": "osd set-backfillfull-ratio", "ratio": 0.55}]=0 osd set-backfillfull-ratio 0.55 v35) v1 ==== 120+0+0 (secure 0 0 0) 0x7f240c0192c0 con 0x7f241808c340 2023-03-03T07:46:28.468 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.466+0000 7f241da5a700 1 -- 172.21.15.57:0/3612850995 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f23fc034800 msgr2=0x7f23fc036cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:28.469 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.466+0000 7f241da5a700 1 --2- 172.21.15.57:0/3612850995 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f23fc034800 0x7f23fc036cb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2404014040 tx=0x7f2404010000 comp rx=0 tx=0).stop 2023-03-03T07:46:28.469 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.466+0000 7f241da5a700 1 -- 172.21.15.57:0/3612850995 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f241808c340 msgr2=0x7f24181c0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:28.469 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.466+0000 7f241da5a700 1 --2- 172.21.15.57:0/3612850995 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f241808c340 0x7f24181c0270 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f240c00c680 tx=0x7f240c00ca40 comp rx=0 tx=0).stop 2023-03-03T07:46:28.470 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.466+0000 7f241da5a700 1 -- 172.21.15.57:0/3612850995 shutdown_connections 2023-03-03T07:46:28.470 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.466+0000 7f241da5a700 1 --2- 172.21.15.57:0/3612850995 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f23fc034800 0x7f23fc036cb0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:28.470 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.466+0000 7f241da5a700 1 --2- 172.21.15.57:0/3612850995 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f241808c340 0x7f24181c0270 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:28.470 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.466+0000 7f241da5a700 1 -- 172.21.15.57:0/3612850995 >> 172.21.15.57:0/3612850995 conn(0x7f241806fa80 msgr2=0x7f2418090050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:46:28.471 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.466+0000 7f241da5a700 1 -- 172.21.15.57:0/3612850995 shutdown_connections 2023-03-03T07:46:28.471 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.466+0000 7f241da5a700 1 -- 172.21.15.57:0/3612850995 wait complete. 2023-03-03T07:46:28.473 INFO:tasks.workunit.client.0.smithi057.stderr:osd set-backfillfull-ratio 0.55 2023-03-03T07:46:28.498 INFO:tasks.workunit.client.0.smithi057.stdout:After ratios are set 2023-03-03T07:46:28.498 INFO:tasks.workunit.client.0.smithi057.stderr:+ echo 'After ratios are set' 2023-03-03T07:46:28.498 INFO:tasks.workunit.client.0.smithi057.stderr:+ df -h 2023-03-03T07:46:28.508 INFO:tasks.workunit.client.0.smithi057.stdout:Filesystem Size Used Avail Use% Mounted on 2023-03-03T07:46:28.508 INFO:tasks.workunit.client.0.smithi057.stdout:udev 16G 0 16G 0% /dev 2023-03-03T07:46:28.508 INFO:tasks.workunit.client.0.smithi057.stdout:tmpfs 3.2G 1.9M 3.2G 1% /run 2023-03-03T07:46:28.508 INFO:tasks.workunit.client.0.smithi057.stdout:/dev/sda1 916G 17G 854G 2% / 2023-03-03T07:46:28.508 INFO:tasks.workunit.client.0.smithi057.stdout:tmpfs 16G 20K 16G 1% /dev/shm 2023-03-03T07:46:28.509 INFO:tasks.workunit.client.0.smithi057.stdout:tmpfs 5.0M 0 5.0M 0% /run/lock 2023-03-03T07:46:28.509 INFO:tasks.workunit.client.0.smithi057.stdout:tmpfs 16G 0 16G 0% /sys/fs/cgroup 2023-03-03T07:46:28.509 INFO:tasks.workunit.client.0.smithi057.stdout:tmpfs 3.2G 0 3.2G 0% /run/user/1000 2023-03-03T07:46:28.509 INFO:tasks.workunit.client.0.smithi057.stdout:/dev/mapper/vg_nvme-lv_5 15G 72M 15G 1% /var/lib/ceph 2023-03-03T07:46:28.509 INFO:tasks.workunit.client.0.smithi057.stdout:ceph-fuse 596M 0 596M 0% /home/ubuntu/cephtest/mnt.0 2023-03-03T07:46:28.509 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph osd df 2023-03-03T07:46:28.680 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.678+0000 7f92c359e700 1 Processor -- start 2023-03-03T07:46:28.681 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.678+0000 7f92c359e700 1 -- start start 2023-03-03T07:46:28.681 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.678+0000 7f92c359e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f92c408e620 0x7f92c408e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:28.682 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.678+0000 7f92c359e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92c4097240 con 0x7f92c408ef30 2023-03-03T07:46:28.682 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.678+0000 7f92c359e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92c406a430 con 0x7f92c408e620 2023-03-03T07:46:28.682 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.678+0000 7f92b9d9b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f92c408ef30 0x7f92c41278f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:32956/0 (socket says 172.21.15.57:32956) 2023-03-03T07:46:28.682 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.678+0000 7f92b9d9b700 1 -- 172.21.15.57:0/4076892290 learned_addr learned my addr 172.21.15.57:0/4076892290 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:46:28.683 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.678+0000 7f92c259c700 1 --2- 172.21.15.57:0/4076892290 >> v2:172.21.15.57:3300/0 conn(0x7f92c408e620 0x7f92c408e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:28.683 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.678+0000 7f92c1d9b700 1 -- 172.21.15.57:0/4076892290 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2849437521 0 0) 0x7f92c4097240 con 0x7f92c408ef30 2023-03-03T07:46:28.683 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.678+0000 7f92c1d9b700 1 -- 172.21.15.57:0/4076892290 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92b00035d0 con 0x7f92c408ef30 2023-03-03T07:46:28.684 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.682+0000 7f92c1d9b700 1 -- 172.21.15.57:0/4076892290 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1051438544 0 0) 0x7f92b00035d0 con 0x7f92c408ef30 2023-03-03T07:46:28.684 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.682+0000 7f92c1d9b700 1 -- 172.21.15.57:0/4076892290 >> v2:172.21.15.57:3300/0 conn(0x7f92c408e620 msgr2=0x7f92c408e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T07:46:28.684 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.682+0000 7f92c1d9b700 1 --2- 172.21.15.57:0/4076892290 >> v2:172.21.15.57:3300/0 conn(0x7f92c408e620 0x7f92c408e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:28.684 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.682+0000 7f92c1d9b700 1 -- 172.21.15.57:0/4076892290 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c4097550 con 0x7f92c408ef30 2023-03-03T07:46:28.685 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.682+0000 7f92c1d9b700 1 -- 172.21.15.57:0/4076892290 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (unknown 2779775165 0 0) 0x7f92ac0015a0 con 0x7f92c408ef30 2023-03-03T07:46:28.685 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.682+0000 7f92c1d9b700 1 -- 172.21.15.57:0/4076892290 >> v1:172.21.15.57:6789/0 conn(0x7f92c408ef30 legacy=0x7f92c41278f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:28.685 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.682+0000 7f92c1d9b700 1 --2- 172.21.15.57:0/4076892290 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92b0003a20 0x7f92b0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:28.685 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.682+0000 7f92c1d9b700 1 -- 172.21.15.57:0/4076892290 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c406a430 con 0x7f92b0003a20 2023-03-03T07:46:28.686 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.682+0000 7f92c259c700 1 --2- 172.21.15.57:0/4076892290 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92b0003a20 0x7f92b0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:28.686 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.682+0000 7f92c259c700 1 -- 172.21.15.57:0/4076892290 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b00035d0 con 0x7f92b0003a20 2023-03-03T07:46:28.686 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.682+0000 7f92c259c700 1 --2- 172.21.15.57:0/4076892290 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92b0003a20 0x7f92b0003e10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f92b4009af0 tx=0x7f92b00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43bb0a09ca350f51 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:28.687 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.682+0000 7f92c1d9b700 1 -- 172.21.15.57:0/4076892290 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92b400e770 con 0x7f92b0003a20 2023-03-03T07:46:28.687 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.682+0000 7f92c1d9b700 1 -- 172.21.15.57:0/4076892290 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b400e8d0 con 0x7f92b0003a20 2023-03-03T07:46:28.687 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.682+0000 7f92c1d9b700 1 -- 172.21.15.57:0/4076892290 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92b400eb70 con 0x7f92b0003a20 2023-03-03T07:46:28.687 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.682+0000 7f92c359e700 1 -- 172.21.15.57:0/4076892290 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92b0003a20 msgr2=0x7f92b0003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:28.688 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.682+0000 7f92c359e700 1 --2- 172.21.15.57:0/4076892290 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92b0003a20 0x7f92b0003e10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f92b4009af0 tx=0x7f92b00058a0 comp rx=0 tx=0).stop 2023-03-03T07:46:28.688 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.686+0000 7f92c359e700 1 -- 172.21.15.57:0/4076892290 shutdown_connections 2023-03-03T07:46:28.688 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.686+0000 7f92c359e700 1 --2- 172.21.15.57:0/4076892290 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92b0003a20 0x7f92b0003e10 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:28.688 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.686+0000 7f92c359e700 1 --2- 172.21.15.57:0/4076892290 >> v2:172.21.15.57:3300/0 conn(0x7f92c408e620 0x7f92c408e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:28.688 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.686+0000 7f92c359e700 1 -- 172.21.15.57:0/4076892290 >> 172.21.15.57:0/4076892290 conn(0x7f92c4095d80 msgr2=0x7f92c4096180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:46:28.688 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.686+0000 7f92c359e700 1 -- 172.21.15.57:0/4076892290 shutdown_connections 2023-03-03T07:46:28.689 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.686+0000 7f92c359e700 1 -- 172.21.15.57:0/4076892290 wait complete. 2023-03-03T07:46:28.690 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.686+0000 7f92c359e700 1 Processor -- start 2023-03-03T07:46:28.691 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.686+0000 7f92c359e700 1 -- start start 2023-03-03T07:46:28.692 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.690+0000 7f92c359e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92b0003a20 0x7f92c4127a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:28.692 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.690+0000 7f92c359e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c4126ed0 con 0x7f92b0003a20 2023-03-03T07:46:28.692 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.690+0000 7f92c259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92b0003a20 0x7f92c4127a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:28.693 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.690+0000 7f92c259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92b0003a20 0x7f92c4127a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34204/0 (socket says 172.21.15.57:34204) 2023-03-03T07:46:28.693 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.690+0000 7f92c259c700 1 -- 172.21.15.57:0/2208124932 learned_addr learned my addr 172.21.15.57:0/2208124932 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:46:28.693 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.690+0000 7f92c259c700 1 -- 172.21.15.57:0/2208124932 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c41283e0 con 0x7f92b0003a20 2023-03-03T07:46:28.693 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.690+0000 7f92c259c700 1 --2- 172.21.15.57:0/2208124932 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92b0003a20 0x7f92c4127a50 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f92c4071700 tx=0x7f92b40047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:28.694 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.690+0000 7f92bb7fe700 1 -- 172.21.15.57:0/2208124932 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92b4021070 con 0x7f92b0003a20 2023-03-03T07:46:28.694 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.690+0000 7f92bb7fe700 1 -- 172.21.15.57:0/2208124932 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b400ed20 con 0x7f92b0003a20 2023-03-03T07:46:28.694 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.690+0000 7f92bb7fe700 1 -- 172.21.15.57:0/2208124932 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92b40036c0 con 0x7f92b0003a20 2023-03-03T07:46:28.694 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.690+0000 7f92c359e700 1 -- 172.21.15.57:0/2208124932 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92c4128250 con 0x7f92b0003a20 2023-03-03T07:46:28.695 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.690+0000 7f92c359e700 1 -- 172.21.15.57:0/2208124932 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92c4128570 con 0x7f92b0003a20 2023-03-03T07:46:28.696 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.694+0000 7f92c359e700 1 -- 172.21.15.57:0/2208124932 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92c40619b0 con 0x7f92b0003a20 2023-03-03T07:46:28.696 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.694+0000 7f92bb7fe700 1 -- 172.21.15.57:0/2208124932 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 42245+0+0 (secure 0 0 0) 0x7f92b402e030 con 0x7f92b0003a20 2023-03-03T07:46:28.697 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.694+0000 7f92bb7fe700 1 --2- 172.21.15.57:0/2208124932 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f92a40347f0 0x7f92a4036ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:28.697 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.694+0000 7f92bb7fe700 1 -- 172.21.15.57:0/2208124932 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 2928+0+0 (secure 0 0 0) 0x7f92b4047860 con 0x7f92b0003a20 2023-03-03T07:46:28.698 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.694+0000 7f92b9d9b700 1 --2- 172.21.15.57:0/2208124932 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f92a40347f0 0x7f92a4036ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:28.698 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.694+0000 7f92b9d9b700 1 --2- 172.21.15.57:0/2208124932 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f92a40347f0 0x7f92a4036ca0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f92ac007980 tx=0x7f92ac0010e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:28.704 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.702+0000 7f92bb7fe700 1 -- 172.21.15.57:0/2208124932 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f92b402f360 con 0x7f92b0003a20 2023-03-03T07:46:28.882 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.878+0000 7f92c359e700 1 -- 172.21.15.57:0/2208124932 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 0: {"prefix": "osd df", "target": ["mon-mgr", ""]}) v1 -- 0x7f92c408e190 con 0x7f92a40347f0 2023-03-03T07:46:28.883 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.882+0000 7f92bb7fe700 1 -- 172.21.15.57:0/2208124932 <== mgr.4099 v2:172.21.15.57:6808/28565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+343 (secure 0 0 0) 0x7f92c408e190 con 0x7f92a40347f0 2023-03-03T07:46:28.978 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.974+0000 7f92c359e700 1 -- 172.21.15.57:0/2208124932 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 1: {"prefix": "osd df", "target": ["mon-mgr", ""]}) v1 -- 0x7f92c4126730 con 0x7f92a40347f0 2023-03-03T07:46:28.979 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.978+0000 7f92bb7fe700 1 -- 172.21.15.57:0/2208124932 <== mgr.4099 v2:172.21.15.57:6808/28565 2 ==== mgr_command_reply(tid 1: 0 ) v1 ==== 8+0+343 (secure 0 0 0) 0x7f92c4126730 con 0x7f92a40347f0 2023-03-03T07:46:28.979 INFO:tasks.workunit.client.0.smithi057.stdout:ID CLASS WEIGHT REWEIGHT SIZE RAW USE DATA OMAP META AVAIL %USE VAR PGS STATUS 2023-03-03T07:46:28.980 INFO:tasks.workunit.client.0.smithi057.stdout: 0 ssd 0.00099 1.00000 1 GiB 15 MiB 1.0 MiB 0 B 14 MiB 1009 MiB 1.49 1.00 105 up 2023-03-03T07:46:28.980 INFO:tasks.workunit.client.0.smithi057.stdout: TOTAL 1 GiB 15 MiB 1.0 MiB 0 B 14 MiB 1009 MiB 1.49 2023-03-03T07:46:28.980 INFO:tasks.workunit.client.0.smithi057.stdout:MIN/MAX VAR: 1.00/1.00 STDDEV: 0 2023-03-03T07:46:28.982 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.978+0000 7f92c359e700 1 -- 172.21.15.57:0/2208124932 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f92a40347f0 msgr2=0x7f92a4036ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:28.982 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.978+0000 7f92c359e700 1 --2- 172.21.15.57:0/2208124932 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f92a40347f0 0x7f92a4036ca0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f92ac007980 tx=0x7f92ac0010e0 comp rx=0 tx=0).stop 2023-03-03T07:46:28.982 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.978+0000 7f92c359e700 1 -- 172.21.15.57:0/2208124932 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92b0003a20 msgr2=0x7f92c4127a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:28.983 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.978+0000 7f92c359e700 1 --2- 172.21.15.57:0/2208124932 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92b0003a20 0x7f92c4127a50 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f92c4071700 tx=0x7f92b40047e0 comp rx=0 tx=0).stop 2023-03-03T07:46:28.983 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.978+0000 7f92c359e700 1 -- 172.21.15.57:0/2208124932 shutdown_connections 2023-03-03T07:46:28.983 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.978+0000 7f92c359e700 1 --2- 172.21.15.57:0/2208124932 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f92a40347f0 0x7f92a4036ca0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:28.983 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.978+0000 7f92c359e700 1 --2- 172.21.15.57:0/2208124932 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92b0003a20 0x7f92c4127a50 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:28.983 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.978+0000 7f92c359e700 1 -- 172.21.15.57:0/2208124932 >> 172.21.15.57:0/2208124932 conn(0x7f92c4095d80 msgr2=0x7f92c412d130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:46:28.984 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.978+0000 7f92c359e700 1 -- 172.21.15.57:0/2208124932 shutdown_connections 2023-03-03T07:46:28.984 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:28.978+0000 7f92c359e700 1 -- 172.21.15.57:0/2208124932 wait complete. 2023-03-03T07:46:29.012 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:29.012 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-1 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:29.082 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:29.083 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:29.083 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.032635 s, 32.1 MB/s 2023-03-03T07:46:29.088 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:29.088 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-2 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:29.152 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:29.152 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:29.153 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258155 s, 40.6 MB/s 2023-03-03T07:46:29.158 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:29.158 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-3 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:29.222 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:29.222 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:29.222 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269722 s, 38.9 MB/s 2023-03-03T07:46:29.227 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:29.227 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-4 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:29.289 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:29.290 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:29.290 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227435 s, 46.1 MB/s 2023-03-03T07:46:29.294 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:29.295 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-5 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:29.355 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:29.355 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:29.355 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236246 s, 44.4 MB/s 2023-03-03T07:46:29.359 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:29.360 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-6 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:29.419 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:29.419 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:29.419 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215691 s, 48.6 MB/s 2023-03-03T07:46:29.425 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:29.425 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-7 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:29.492 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:29.493 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:29.493 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261276 s, 40.1 MB/s 2023-03-03T07:46:29.497 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:29.498 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-8 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:29.560 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:29.560 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:29.561 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230236 s, 45.5 MB/s 2023-03-03T07:46:29.566 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:29.566 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-9 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:29.629 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:29.629 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:29.629 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243813 s, 43.0 MB/s 2023-03-03T07:46:29.634 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:29.634 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-10 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:29.695 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:29.695 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:29.696 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247295 s, 42.4 MB/s 2023-03-03T07:46:29.701 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:29.701 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-11 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:29.762 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:29.763 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:29.763 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221524 s, 47.3 MB/s 2023-03-03T07:46:29.768 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:29.768 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-12 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:29.829 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:29.829 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:29.829 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229088 s, 45.8 MB/s 2023-03-03T07:46:29.835 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:29.835 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-13 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:29.896 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:29.896 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:29.897 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220625 s, 47.5 MB/s 2023-03-03T07:46:29.901 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:29.901 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-14 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:29.966 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:29.967 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:29.967 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251396 s, 41.7 MB/s 2023-03-03T07:46:29.971 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:29.971 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-15 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:30.035 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:30.035 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:30.035 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216936 s, 48.3 MB/s 2023-03-03T07:46:30.039 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:30.039 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-16 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:30.099 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:30.099 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:30.099 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232839 s, 45.0 MB/s 2023-03-03T07:46:30.104 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:30.105 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-17 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:30.169 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:30.169 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:30.169 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260743 s, 40.2 MB/s 2023-03-03T07:46:30.173 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:30.174 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-18 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:30.235 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:30.235 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:30.235 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222571 s, 47.1 MB/s 2023-03-03T07:46:30.240 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:30.240 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-19 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:30.297 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:30.297 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:30.297 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215282 s, 48.7 MB/s 2023-03-03T07:46:30.301 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:30.301 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-20 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:30.361 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:30.362 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:30.362 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238643 s, 43.9 MB/s 2023-03-03T07:46:30.367 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:30.367 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-21 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:30.428 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:30.428 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:30.428 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243199 s, 43.1 MB/s 2023-03-03T07:46:30.433 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:30.433 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-22 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:30.500 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:30.501 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:30.501 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269891 s, 38.9 MB/s 2023-03-03T07:46:30.506 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:30.506 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-23 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:30.572 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:30.572 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:30.573 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266107 s, 39.4 MB/s 2023-03-03T07:46:30.576 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:30.577 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-24 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:30.637 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:30.637 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:30.638 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234703 s, 44.7 MB/s 2023-03-03T07:46:30.642 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:30.642 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-25 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:30.707 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:30.707 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:30.707 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246712 s, 42.5 MB/s 2023-03-03T07:46:30.712 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:30.712 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-26 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:30.772 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:30.772 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:30.773 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216619 s, 48.4 MB/s 2023-03-03T07:46:30.777 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:30.777 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-27 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:30.838 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:30.838 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:30.838 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225461 s, 46.5 MB/s 2023-03-03T07:46:30.842 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:30.842 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-28 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:30.902 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:30.902 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:30.902 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239976 s, 43.7 MB/s 2023-03-03T07:46:30.906 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:30.906 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-29 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:30.966 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:30.966 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:30.967 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240015 s, 43.7 MB/s 2023-03-03T07:46:30.971 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:30.971 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-30 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:31.031 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:31.031 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:31.031 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239429 s, 43.8 MB/s 2023-03-03T07:46:31.036 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:31.036 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-31 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:31.098 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:31.098 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:31.098 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256479 s, 40.9 MB/s 2023-03-03T07:46:31.103 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:31.103 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-32 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:31.168 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:31.169 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:31.169 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237151 s, 44.2 MB/s 2023-03-03T07:46:31.173 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:31.173 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-33 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:31.234 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:31.235 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:31.235 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220329 s, 47.6 MB/s 2023-03-03T07:46:31.240 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:31.240 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-34 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:31.298 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:31.299 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:31.299 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224533 s, 46.7 MB/s 2023-03-03T07:46:31.306 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:31.306 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-35 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:31.365 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:31.365 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:31.366 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234444 s, 44.7 MB/s 2023-03-03T07:46:31.370 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:31.372 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-36 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:31.433 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:31.433 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:31.433 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244016 s, 43.0 MB/s 2023-03-03T07:46:31.439 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:31.439 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-37 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:31.510 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:31.510 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:31.510 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0321453 s, 32.6 MB/s 2023-03-03T07:46:31.514 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:31.514 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-38 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:31.577 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:31.578 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:31.578 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253434 s, 41.4 MB/s 2023-03-03T07:46:31.582 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:31.582 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-39 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:31.643 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:31.644 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:31.644 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023057 s, 45.5 MB/s 2023-03-03T07:46:31.649 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:31.649 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-40 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:31.707 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:31.708 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:31.708 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231754 s, 45.2 MB/s 2023-03-03T07:46:31.713 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:31.713 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-41 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:31.774 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:31.774 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:31.775 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245524 s, 42.7 MB/s 2023-03-03T07:46:31.779 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:31.779 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-42 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:31.843 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:31.844 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:31.844 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261581 s, 40.1 MB/s 2023-03-03T07:46:31.850 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:31.850 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-43 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:31.913 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:31.913 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:31.914 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228314 s, 45.9 MB/s 2023-03-03T07:46:31.918 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:31.918 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-44 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:31.983 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:31.984 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:31.984 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025287 s, 41.5 MB/s 2023-03-03T07:46:31.988 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:31.988 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-45 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:32.049 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:32.050 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:32.050 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240454 s, 43.6 MB/s 2023-03-03T07:46:32.054 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:32.054 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-46 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:32.119 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:32.119 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:32.119 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249701 s, 42.0 MB/s 2023-03-03T07:46:32.124 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:32.124 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-47 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:32.184 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:32.185 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:32.185 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229665 s, 45.7 MB/s 2023-03-03T07:46:32.190 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:32.190 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-48 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:32.257 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:32.257 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:32.258 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279793 s, 37.5 MB/s 2023-03-03T07:46:32.263 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:32.263 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-49 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:32.320 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:32.321 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:32.321 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206686 s, 50.7 MB/s 2023-03-03T07:46:32.325 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:32.325 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-50 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:32.388 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:32.388 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:32.389 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024447 s, 42.9 MB/s 2023-03-03T07:46:32.394 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:32.394 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-51 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:32.456 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:32.457 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:32.457 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247527 s, 42.4 MB/s 2023-03-03T07:46:32.462 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:32.462 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-52 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:32.531 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:32.532 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:32.532 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0294193 s, 35.6 MB/s 2023-03-03T07:46:32.536 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:32.537 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-53 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:32.599 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:32.599 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:32.600 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251289 s, 41.7 MB/s 2023-03-03T07:46:32.604 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:32.604 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-54 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:32.669 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:32.669 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:32.670 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243478 s, 43.1 MB/s 2023-03-03T07:46:32.674 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:32.674 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-55 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:32.738 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:32.739 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:32.739 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245878 s, 42.6 MB/s 2023-03-03T07:46:32.744 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:32.744 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-56 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:32.810 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:32.810 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:32.810 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243745 s, 43.0 MB/s 2023-03-03T07:46:32.815 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:32.815 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-57 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:32.880 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:32.881 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:32.881 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279861 s, 37.5 MB/s 2023-03-03T07:46:32.886 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:32.886 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-58 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:32.948 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:32.949 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:32.949 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235986 s, 44.4 MB/s 2023-03-03T07:46:32.953 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:32.953 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-59 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:33.020 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:33.020 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:33.020 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026549 s, 39.5 MB/s 2023-03-03T07:46:33.025 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:33.025 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-60 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:33.087 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:33.087 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:33.087 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230558 s, 45.5 MB/s 2023-03-03T07:46:33.092 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:33.092 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-61 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:33.155 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:33.156 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:33.156 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024576 s, 42.7 MB/s 2023-03-03T07:46:33.160 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:33.161 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-62 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:33.219 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:33.220 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:33.220 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02249 s, 46.6 MB/s 2023-03-03T07:46:33.223 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:33.223 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-63 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:33.285 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:33.285 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:33.285 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208947 s, 50.2 MB/s 2023-03-03T07:46:33.290 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:33.290 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-64 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:33.350 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:33.351 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:33.351 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223761 s, 46.9 MB/s 2023-03-03T07:46:33.355 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:33.355 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-65 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:33.417 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:33.418 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:33.418 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240045 s, 43.7 MB/s 2023-03-03T07:46:33.422 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:33.422 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-66 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:33.486 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:33.486 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:33.486 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232125 s, 45.2 MB/s 2023-03-03T07:46:33.490 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:33.490 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-67 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:33.561 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:33.561 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:33.561 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0307628 s, 34.1 MB/s 2023-03-03T07:46:33.564 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:33.564 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-68 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:33.629 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:33.629 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:33.630 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248288 s, 42.2 MB/s 2023-03-03T07:46:33.634 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:33.634 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-69 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:33.695 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:33.696 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:33.696 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223651 s, 46.9 MB/s 2023-03-03T07:46:33.699 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:33.699 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-70 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:33.764 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:33.765 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:33.765 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025999 s, 40.3 MB/s 2023-03-03T07:46:33.769 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:33.769 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-71 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:33.835 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:33.835 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:33.835 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260076 s, 40.3 MB/s 2023-03-03T07:46:33.840 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:33.840 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-72 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:33.901 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:33.901 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:33.901 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228742 s, 45.8 MB/s 2023-03-03T07:46:33.905 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:33.905 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-73 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:33.967 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:33.967 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:33.967 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232213 s, 45.2 MB/s 2023-03-03T07:46:33.972 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:33.972 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-74 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:34.035 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:34.035 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:34.036 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244912 s, 42.8 MB/s 2023-03-03T07:46:34.040 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:34.041 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-75 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:34.104 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:34.105 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:34.105 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248993 s, 42.1 MB/s 2023-03-03T07:46:34.110 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:34.110 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-76 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:34.174 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:34.174 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:34.174 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232868 s, 45.0 MB/s 2023-03-03T07:46:34.178 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:34.178 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-77 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:34.239 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:34.239 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:34.239 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238917 s, 43.9 MB/s 2023-03-03T07:46:34.245 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:34.245 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-78 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:34.289 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:46:34.307 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:34.307 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:34.307 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022348 s, 46.9 MB/s 2023-03-03T07:46:34.310 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:34.311 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-79 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:34.364 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:34.365 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:34.365 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212435 s, 49.4 MB/s 2023-03-03T07:46:34.368 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:34.368 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-80 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:34.419 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:34.419 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:34.419 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171612 s, 61.1 MB/s 2023-03-03T07:46:34.423 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:34.423 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-81 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:34.484 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:34.485 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:34.485 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234302 s, 44.8 MB/s 2023-03-03T07:46:34.488 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:34.488 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-82 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:34.552 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:34.552 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:34.553 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0296195 s, 35.4 MB/s 2023-03-03T07:46:34.559 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:34.559 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-83 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:34.621 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:34.622 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:34.622 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231825 s, 45.2 MB/s 2023-03-03T07:46:34.627 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:34.627 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-84 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:34.691 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:34.692 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:34.692 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253967 s, 41.3 MB/s 2023-03-03T07:46:34.696 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:34.697 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-85 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:34.757 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:34.758 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:34.758 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023573 s, 44.5 MB/s 2023-03-03T07:46:34.763 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:34.763 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-86 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:34.829 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:34.830 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:34.830 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268697 s, 39.0 MB/s 2023-03-03T07:46:34.834 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:34.834 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-87 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:34.898 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:34.898 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:34.898 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262624 s, 39.9 MB/s 2023-03-03T07:46:34.902 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:34.902 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-88 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:34.963 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:34.963 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:34.963 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242273 s, 43.3 MB/s 2023-03-03T07:46:34.969 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:34.969 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-89 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:35.032 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:35.032 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:35.033 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260316 s, 40.3 MB/s 2023-03-03T07:46:35.036 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:35.036 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-90 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:35.096 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:35.096 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:35.096 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260955 s, 40.2 MB/s 2023-03-03T07:46:35.101 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:35.102 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-91 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:35.167 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:35.167 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:35.167 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249982 s, 41.9 MB/s 2023-03-03T07:46:35.173 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:35.174 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-92 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:35.235 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:35.235 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:35.235 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231262 s, 45.3 MB/s 2023-03-03T07:46:35.239 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:35.239 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-93 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:35.303 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:35.304 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:35.304 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236479 s, 44.3 MB/s 2023-03-03T07:46:35.307 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:35.308 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-94 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:35.367 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:35.367 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:35.367 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205346 s, 51.1 MB/s 2023-03-03T07:46:35.370 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:35.370 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-95 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:35.432 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:35.432 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:35.432 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238797 s, 43.9 MB/s 2023-03-03T07:46:35.437 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:35.437 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-96 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:35.493 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:35.494 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:35.494 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218495 s, 48.0 MB/s 2023-03-03T07:46:35.500 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:35.500 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-97 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:35.563 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:35.564 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:35.564 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0286054 s, 36.7 MB/s 2023-03-03T07:46:35.569 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:35.569 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-98 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:35.628 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:35.629 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:35.629 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228187 s, 46.0 MB/s 2023-03-03T07:46:35.633 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:35.633 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-99 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:35.697 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:35.697 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:35.698 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239209 s, 43.8 MB/s 2023-03-03T07:46:35.702 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in {1..100} 2023-03-03T07:46:35.702 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/3d870f2e-de6c-46a1-bd62-996825af0012/1MB_file-100 status=progress bs=1M count=1 conv=fdatasync 2023-03-03T07:46:35.763 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records in 2023-03-03T07:46:35.763 INFO:tasks.workunit.client.0.smithi057.stderr:1+0 records out 2023-03-03T07:46:35.763 INFO:tasks.workunit.client.0.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236544 s, 44.3 MB/s 2023-03-03T07:46:35.768 INFO:tasks.workunit.client.0.smithi057.stdout:After subvolumes are written 2023-03-03T07:46:35.769 INFO:tasks.workunit.client.0.smithi057.stderr:+ echo 'After subvolumes are written' 2023-03-03T07:46:35.769 INFO:tasks.workunit.client.0.smithi057.stderr:+ df -h /home/ubuntu/cephtest/mnt.0 2023-03-03T07:46:35.778 INFO:tasks.workunit.client.0.smithi057.stdout:Filesystem Size Used Avail Use% Mounted on 2023-03-03T07:46:35.778 INFO:tasks.workunit.client.0.smithi057.stdout:ceph-fuse 608M 56M 552M 10% /home/ubuntu/cephtest/mnt.0 2023-03-03T07:46:35.779 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph osd df 2023-03-03T07:46:35.942 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:35.938+0000 7f45392e7700 1 Processor -- start 2023-03-03T07:46:35.942 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:35.938+0000 7f45392e7700 1 -- start start 2023-03-03T07:46:35.943 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:35.942+0000 7f45392e7700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f453408ba90 0x7f4534128fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:35.943 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:35.942+0000 7f45392e7700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f453408d260 con 0x7f453408afb0 2023-03-03T07:46:35.943 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:35.942+0000 7f45392e7700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4534071ca0 con 0x7f453408ba90 2023-03-03T07:46:35.944 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:35.942+0000 7f4533fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f453408afb0 0x7f453408b380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:40970/0 (socket says 172.21.15.57:40970) 2023-03-03T07:46:35.944 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:35.942+0000 7f4533fff700 1 -- 172.21.15.57:0/1492275504 learned_addr learned my addr 172.21.15.57:0/1492275504 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:46:35.944 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:35.942+0000 7f45337fe700 1 --2- 172.21.15.57:0/1492275504 >> v2:172.21.15.57:3300/0 conn(0x7f453408ba90 0x7f4534128fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:35.945 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:35.942+0000 7f4532ffd700 1 -- 172.21.15.57:0/1492275504 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1701061246 0 0) 0x7f453408d260 con 0x7f453408afb0 2023-03-03T07:46:35.945 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:35.942+0000 7f4532ffd700 1 -- 172.21.15.57:0/1492275504 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f451c0035d0 con 0x7f453408afb0 2023-03-03T07:46:35.945 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:35.942+0000 7f45337fe700 1 -- 172.21.15.57:0/1492275504 >> v1:172.21.15.57:6789/0 conn(0x7f453408afb0 legacy=0x7f453408b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:35.946 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:35.942+0000 7f45337fe700 1 -- 172.21.15.57:0/1492275504 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f453408d490 con 0x7f453408ba90 2023-03-03T07:46:35.946 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:35.942+0000 7f45337fe700 1 --2- 172.21.15.57:0/1492275504 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f453408ba90 0x7f4534128fc0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f452800a970 tx=0x7f452800ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=350be6b4ec800908 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:35.947 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:35.946+0000 7f4532ffd700 1 -- 172.21.15.57:0/1492275504 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4528004160 con 0x7f453408ba90 2023-03-03T07:46:35.947 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:35.946+0000 7f4532ffd700 1 -- 172.21.15.57:0/1492275504 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45280042c0 con 0x7f453408ba90 2023-03-03T07:46:35.948 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:35.946+0000 7f4532ffd700 1 -- 172.21.15.57:0/1492275504 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4528004580 con 0x7f453408ba90 2023-03-03T07:46:35.948 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:35.946+0000 7f45392e7700 1 -- 172.21.15.57:0/1492275504 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f453408ba90 msgr2=0x7f4534128fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:35.948 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:35.946+0000 7f45392e7700 1 --2- 172.21.15.57:0/1492275504 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f453408ba90 0x7f4534128fc0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f452800a970 tx=0x7f452800ac80 comp rx=0 tx=0).stop 2023-03-03T07:46:35.949 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:35.946+0000 7f45392e7700 1 -- 172.21.15.57:0/1492275504 shutdown_connections 2023-03-03T07:46:35.949 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:35.946+0000 7f45392e7700 1 --2- 172.21.15.57:0/1492275504 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f453408ba90 0x7f4534128fc0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:35.950 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:35.946+0000 7f45392e7700 1 -- 172.21.15.57:0/1492275504 >> 172.21.15.57:0/1492275504 conn(0x7f45340943e0 msgr2=0x7f4534095e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:46:35.950 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:35.946+0000 7f45392e7700 1 -- 172.21.15.57:0/1492275504 shutdown_connections 2023-03-03T07:46:35.950 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:35.946+0000 7f45392e7700 1 -- 172.21.15.57:0/1492275504 wait complete. 2023-03-03T07:46:35.952 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:35.950+0000 7f45392e7700 1 Processor -- start 2023-03-03T07:46:35.952 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:35.950+0000 7f45392e7700 1 -- start start 2023-03-03T07:46:35.953 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:35.950+0000 7f45392e7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f453408afb0 0x7f45341b7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:35.954 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:35.950+0000 7f45392e7700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f453411c1e0 con 0x7f453408afb0 2023-03-03T07:46:35.954 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:35.950+0000 7f4533fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f453408afb0 0x7f45341b7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:35.954 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:35.950+0000 7f4533fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f453408afb0 0x7f45341b7ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48006/0 (socket says 172.21.15.57:48006) 2023-03-03T07:46:35.954 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:35.950+0000 7f4533fff700 1 -- 172.21.15.57:0/436428164 learned_addr learned my addr 172.21.15.57:0/436428164 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:46:35.955 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:35.950+0000 7f4533fff700 1 -- 172.21.15.57:0/436428164 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f452800a650 con 0x7f453408afb0 2023-03-03T07:46:35.955 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:35.954+0000 7f4533fff700 1 --2- 172.21.15.57:0/436428164 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f453408afb0 0x7f45341b7ae0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f452400c470 tx=0x7f452400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:35.956 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:35.954+0000 7f4530ff9700 1 -- 172.21.15.57:0/436428164 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4524005cc0 con 0x7f453408afb0 2023-03-03T07:46:35.956 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:35.954+0000 7f4530ff9700 1 -- 172.21.15.57:0/436428164 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4524005e20 con 0x7f453408afb0 2023-03-03T07:46:35.956 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:35.954+0000 7f4530ff9700 1 -- 172.21.15.57:0/436428164 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4524007220 con 0x7f453408afb0 2023-03-03T07:46:35.956 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:35.954+0000 7f45392e7700 1 -- 172.21.15.57:0/436428164 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4534069f30 con 0x7f453408afb0 2023-03-03T07:46:35.956 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:35.954+0000 7f45392e7700 1 -- 172.21.15.57:0/436428164 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4534069da0 con 0x7f453408afb0 2023-03-03T07:46:35.957 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:35.954+0000 7f45392e7700 1 -- 172.21.15.57:0/436428164 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4534129500 con 0x7f453408afb0 2023-03-03T07:46:35.958 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:35.954+0000 7f4530ff9700 1 -- 172.21.15.57:0/436428164 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 42245+0+0 (secure 0 0 0) 0x7f4524019030 con 0x7f453408afb0 2023-03-03T07:46:35.958 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:35.954+0000 7f4530ff9700 1 --2- 172.21.15.57:0/436428164 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f45200347f0 0x7f4520036ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:35.958 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:35.954+0000 7f4530ff9700 1 -- 172.21.15.57:0/436428164 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 2928+0+0 (secure 0 0 0) 0x7f4524045560 con 0x7f453408afb0 2023-03-03T07:46:35.959 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:35.954+0000 7f45337fe700 1 --2- 172.21.15.57:0/436428164 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f45200347f0 0x7f4520036ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:35.960 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:35.958+0000 7f45337fe700 1 --2- 172.21.15.57:0/436428164 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f45200347f0 0x7f4520036ca0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f452800a970 tx=0x7f4528012000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:35.965 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:35.962+0000 7f4530ff9700 1 -- 172.21.15.57:0/436428164 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f45240192c0 con 0x7f453408afb0 2023-03-03T07:46:36.140 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.138+0000 7f45392e7700 1 -- 172.21.15.57:0/436428164 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 0: {"prefix": "osd df", "target": ["mon-mgr", ""]}) v1 -- 0x7f453404e230 con 0x7f45200347f0 2023-03-03T07:46:36.142 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.138+0000 7f4530ff9700 1 -- 172.21.15.57:0/436428164 <== mgr.4099 v2:172.21.15.57:6808/28565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f453404e230 con 0x7f45200347f0 2023-03-03T07:46:36.242 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.238+0000 7f45392e7700 1 -- 172.21.15.57:0/436428164 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 1: {"prefix": "osd df", "target": ["mon-mgr", ""]}) v1 -- 0x7f45340619b0 con 0x7f45200347f0 2023-03-03T07:46:36.243 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.242+0000 7f4530ff9700 1 -- 172.21.15.57:0/436428164 <== mgr.4099 v2:172.21.15.57:6808/28565 2 ==== mgr_command_reply(tid 1: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f45340619b0 con 0x7f45200347f0 2023-03-03T07:46:36.243 INFO:tasks.workunit.client.0.smithi057.stdout:ID CLASS WEIGHT REWEIGHT SIZE RAW USE DATA OMAP META AVAIL %USE VAR PGS STATUS 2023-03-03T07:46:36.244 INFO:tasks.workunit.client.0.smithi057.stdout: 0 ssd 0.00099 1.00000 1 GiB 60 MiB 45 MiB 0 B 15 MiB 964 MiB 5.84 1.00 105 up 2023-03-03T07:46:36.244 INFO:tasks.workunit.client.0.smithi057.stdout: TOTAL 1 GiB 60 MiB 45 MiB 0 B 15 MiB 964 MiB 5.84 2023-03-03T07:46:36.244 INFO:tasks.workunit.client.0.smithi057.stdout:MIN/MAX VAR: 1.00/1.00 STDDEV: 0 2023-03-03T07:46:36.246 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.242+0000 7f45392e7700 1 -- 172.21.15.57:0/436428164 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f45200347f0 msgr2=0x7f4520036ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:36.246 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.242+0000 7f45392e7700 1 --2- 172.21.15.57:0/436428164 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f45200347f0 0x7f4520036ca0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f452800a970 tx=0x7f4528012000 comp rx=0 tx=0).stop 2023-03-03T07:46:36.247 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.242+0000 7f45392e7700 1 -- 172.21.15.57:0/436428164 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f453408afb0 msgr2=0x7f45341b7ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:36.247 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.242+0000 7f45392e7700 1 --2- 172.21.15.57:0/436428164 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f453408afb0 0x7f45341b7ae0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f452400c470 tx=0x7f452400c830 comp rx=0 tx=0).stop 2023-03-03T07:46:36.248 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.242+0000 7f45392e7700 1 -- 172.21.15.57:0/436428164 shutdown_connections 2023-03-03T07:46:36.248 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.242+0000 7f45392e7700 1 --2- 172.21.15.57:0/436428164 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f45200347f0 0x7f4520036ca0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:36.249 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.242+0000 7f45392e7700 1 --2- 172.21.15.57:0/436428164 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f453408afb0 0x7f45341b7ae0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:36.249 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.242+0000 7f45392e7700 1 -- 172.21.15.57:0/436428164 >> 172.21.15.57:0/436428164 conn(0x7f45340943e0 msgr2=0x7f45340908e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:46:36.249 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.246+0000 7f45392e7700 1 -- 172.21.15.57:0/436428164 shutdown_connections 2023-03-03T07:46:36.249 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.246+0000 7f45392e7700 1 -- 172.21.15.57:0/436428164 wait complete. 2023-03-03T07:46:36.275 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph fs subvolume snapshot create cephfs sub_0 snap_0 2023-03-03T07:46:36.453 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.450+0000 7fda28a5a700 1 Processor -- start 2023-03-03T07:46:36.454 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.450+0000 7fda28a5a700 1 -- start start 2023-03-03T07:46:36.456 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.454+0000 7fda28a5a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fda2408e4c0 0x7fda2408e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:36.456 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.454+0000 7fda28a5a700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda2408f8e0 con 0x7fda2408edd0 2023-03-03T07:46:36.456 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.454+0000 7fda28a5a700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda2408f760 con 0x7fda2408e4c0 2023-03-03T07:46:36.457 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.454+0000 7fda22d9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fda2408e4c0 0x7fda2408e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:36.457 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.454+0000 7fda2259c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fda2408edd0 0x7fda241246b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:40974/0 (socket says 172.21.15.57:40974) 2023-03-03T07:46:36.458 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.454+0000 7fda2259c700 1 -- 172.21.15.57:0/2857587048 learned_addr learned my addr 172.21.15.57:0/2857587048 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:46:36.458 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.454+0000 7fda21d9b700 1 -- 172.21.15.57:0/2857587048 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3288422141 0 0) 0x7fda2408f8e0 con 0x7fda2408edd0 2023-03-03T07:46:36.458 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.454+0000 7fda21d9b700 1 -- 172.21.15.57:0/2857587048 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda0c0035d0 con 0x7fda2408edd0 2023-03-03T07:46:36.459 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.454+0000 7fda22d9d700 1 -- 172.21.15.57:0/2857587048 >> v1:172.21.15.57:6789/0 conn(0x7fda2408edd0 legacy=0x7fda241246b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:36.459 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.454+0000 7fda22d9d700 1 -- 172.21.15.57:0/2857587048 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda24090650 con 0x7fda2408e4c0 2023-03-03T07:46:36.459 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.454+0000 7fda22d9d700 1 --2- 172.21.15.57:0/2857587048 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda2408e4c0 0x7fda2408e890 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fda140097d0 tx=0x7fda14009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55632101688cad1e server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:36.459 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.458+0000 7fda21d9b700 1 -- 172.21.15.57:0/2857587048 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fda14004160 con 0x7fda2408e4c0 2023-03-03T07:46:36.460 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.458+0000 7fda21d9b700 1 -- 172.21.15.57:0/2857587048 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda140042c0 con 0x7fda2408e4c0 2023-03-03T07:46:36.460 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.458+0000 7fda21d9b700 1 -- 172.21.15.57:0/2857587048 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fda140045a0 con 0x7fda2408e4c0 2023-03-03T07:46:36.460 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.458+0000 7fda28a5a700 1 -- 172.21.15.57:0/2857587048 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda2408e4c0 msgr2=0x7fda2408e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:36.461 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.458+0000 7fda28a5a700 1 --2- 172.21.15.57:0/2857587048 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda2408e4c0 0x7fda2408e890 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fda140097d0 tx=0x7fda14009ae0 comp rx=0 tx=0).stop 2023-03-03T07:46:36.461 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.458+0000 7fda28a5a700 1 -- 172.21.15.57:0/2857587048 shutdown_connections 2023-03-03T07:46:36.461 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.458+0000 7fda28a5a700 1 --2- 172.21.15.57:0/2857587048 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda2408e4c0 0x7fda2408e890 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:36.461 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.458+0000 7fda28a5a700 1 -- 172.21.15.57:0/2857587048 >> 172.21.15.57:0/2857587048 conn(0x7fda24089fa0 msgr2=0x7fda2408c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:46:36.461 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.458+0000 7fda28a5a700 1 -- 172.21.15.57:0/2857587048 shutdown_connections 2023-03-03T07:46:36.462 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.458+0000 7fda28a5a700 1 -- 172.21.15.57:0/2857587048 wait complete. 2023-03-03T07:46:36.463 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.462+0000 7fda28a5a700 1 Processor -- start 2023-03-03T07:46:36.463 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.462+0000 7fda28a5a700 1 -- start start 2023-03-03T07:46:36.464 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.462+0000 7fda28a5a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda2408e4c0 0x7fda241bc170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:36.464 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.462+0000 7fda28a5a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda24122be0 con 0x7fda2408e4c0 2023-03-03T07:46:36.465 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.462+0000 7fda22d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda2408e4c0 0x7fda241bc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:36.465 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.462+0000 7fda22d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda2408e4c0 0x7fda241bc170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48016/0 (socket says 172.21.15.57:48016) 2023-03-03T07:46:36.465 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.462+0000 7fda22d9d700 1 -- 172.21.15.57:0/3421334951 learned_addr learned my addr 172.21.15.57:0/3421334951 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:46:36.466 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.462+0000 7fda22d9d700 1 -- 172.21.15.57:0/3421334951 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda140094b0 con 0x7fda2408e4c0 2023-03-03T07:46:36.466 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.462+0000 7fda22d9d700 1 --2- 172.21.15.57:0/3421334951 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda2408e4c0 0x7fda241bc170 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fda140090b0 tx=0x7fda14004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:36.467 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.462+0000 7fda0b7fe700 1 -- 172.21.15.57:0/3421334951 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fda14003cc0 con 0x7fda2408e4c0 2023-03-03T07:46:36.467 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.462+0000 7fda0b7fe700 1 -- 172.21.15.57:0/3421334951 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda1401f070 con 0x7fda2408e4c0 2023-03-03T07:46:36.467 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.462+0000 7fda0b7fe700 1 -- 172.21.15.57:0/3421334951 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fda14011630 con 0x7fda2408e4c0 2023-03-03T07:46:36.467 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.462+0000 7fda28a5a700 1 -- 172.21.15.57:0/3421334951 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda241251a0 con 0x7fda2408e4c0 2023-03-03T07:46:36.468 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.466+0000 7fda28a5a700 1 -- 172.21.15.57:0/3421334951 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda24125010 con 0x7fda2408e4c0 2023-03-03T07:46:36.469 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.466+0000 7fda0b7fe700 1 -- 172.21.15.57:0/3421334951 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 42245+0+0 (secure 0 0 0) 0x7fda1402a020 con 0x7fda2408e4c0 2023-03-03T07:46:36.469 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.466+0000 7fda28a5a700 1 -- 172.21.15.57:0/3421334951 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda24125330 con 0x7fda2408e4c0 2023-03-03T07:46:36.470 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.466+0000 7fda0b7fe700 1 --2- 172.21.15.57:0/3421334951 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fda100347f0 0x7fda10036ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:36.470 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.466+0000 7fda0b7fe700 1 -- 172.21.15.57:0/3421334951 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 2928+0+0 (secure 0 0 0) 0x7fda14047890 con 0x7fda2408e4c0 2023-03-03T07:46:36.470 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.466+0000 7fda2259c700 1 --2- 172.21.15.57:0/3421334951 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fda100347f0 0x7fda10036ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:36.471 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.470+0000 7fda2259c700 1 --2- 172.21.15.57:0/3421334951 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fda100347f0 0x7fda10036ca0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fda180011e0 tx=0x7fda18007a20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:36.477 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.474+0000 7fda0b7fe700 1 -- 172.21.15.57:0/3421334951 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fda14010380 con 0x7fda2408e4c0 2023-03-03T07:46:36.680 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.678+0000 7fda28a5a700 1 -- 172.21.15.57:0/3421334951 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "sub_0", "snap_name": "snap_0", "target": ["mon-mgr", ""]}) v1 -- 0x7fda240619b0 con 0x7fda100347f0 2023-03-03T07:46:36.709 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.706+0000 7fda0b7fe700 1 -- 172.21.15.57:0/3421334951 <== mgr.4099 v2:172.21.15.57:6808/28565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fda240619b0 con 0x7fda100347f0 2023-03-03T07:46:36.839 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.834+0000 7fda28a5a700 1 -- 172.21.15.57:0/3421334951 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 1: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "sub_0", "snap_name": "snap_0", "target": ["mon-mgr", ""]}) v1 -- 0x7fda24122d30 con 0x7fda100347f0 2023-03-03T07:46:36.855 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.854+0000 7fda0b7fe700 1 -- 172.21.15.57:0/3421334951 <== mgr.4099 v2:172.21.15.57:6808/28565 2 ==== mgr_command_reply(tid 1: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fda24122d30 con 0x7fda100347f0 2023-03-03T07:46:36.859 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.854+0000 7fda28a5a700 1 -- 172.21.15.57:0/3421334951 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fda100347f0 msgr2=0x7fda10036ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:36.860 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.854+0000 7fda28a5a700 1 --2- 172.21.15.57:0/3421334951 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fda100347f0 0x7fda10036ca0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fda180011e0 tx=0x7fda18007a20 comp rx=0 tx=0).stop 2023-03-03T07:46:36.860 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.854+0000 7fda28a5a700 1 -- 172.21.15.57:0/3421334951 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda2408e4c0 msgr2=0x7fda241bc170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:36.860 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.854+0000 7fda28a5a700 1 --2- 172.21.15.57:0/3421334951 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda2408e4c0 0x7fda241bc170 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fda140090b0 tx=0x7fda14004770 comp rx=0 tx=0).stop 2023-03-03T07:46:36.860 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.858+0000 7fda28a5a700 1 -- 172.21.15.57:0/3421334951 shutdown_connections 2023-03-03T07:46:36.860 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.858+0000 7fda28a5a700 1 --2- 172.21.15.57:0/3421334951 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fda100347f0 0x7fda10036ca0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:36.860 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.858+0000 7fda28a5a700 1 --2- 172.21.15.57:0/3421334951 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda2408e4c0 0x7fda241bc170 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:36.860 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.858+0000 7fda28a5a700 1 -- 172.21.15.57:0/3421334951 >> 172.21.15.57:0/3421334951 conn(0x7fda24089fa0 msgr2=0x7fda24118810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:46:36.861 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.858+0000 7fda28a5a700 1 -- 172.21.15.57:0/3421334951 shutdown_connections 2023-03-03T07:46:36.861 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:36.858+0000 7fda28a5a700 1 -- 172.21.15.57:0/3421334951 wait complete. 2023-03-03T07:46:36.886 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph config set mgr mgr/volumes/snapshot_clone_delay 15 2023-03-03T07:46:37.058 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.054+0000 7f642d9b4700 1 Processor -- start 2023-03-03T07:46:37.059 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.054+0000 7f642d9b4700 1 -- start start 2023-03-03T07:46:37.060 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.058+0000 7f642d9b4700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6428095eb0 0x7f6428123480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:37.061 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.058+0000 7f642d9b4700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f642808d930 con 0x7f642808afb0 2023-03-03T07:46:37.061 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.058+0000 7f642d9b4700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64281242f0 con 0x7f6428095eb0 2023-03-03T07:46:37.061 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.058+0000 7f642c9b2700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6428095eb0 0x7f6428123480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:37.062 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.058+0000 7f6427fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f642808afb0 0x7f642808b420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:40976/0 (socket says 172.21.15.57:40976) 2023-03-03T07:46:37.062 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.058+0000 7f6427fff700 1 -- 172.21.15.57:0/3447703656 learned_addr learned my addr 172.21.15.57:0/3447703656 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:46:37.063 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.058+0000 7f642c9b2700 1 -- 172.21.15.57:0/3447703656 >> v1:172.21.15.57:6789/0 conn(0x7f642808afb0 legacy=0x7f642808b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:37.063 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.058+0000 7f642c9b2700 1 -- 172.21.15.57:0/3447703656 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f642808bb30 con 0x7f6428095eb0 2023-03-03T07:46:37.063 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.058+0000 7f64277fe700 1 -- 172.21.15.57:0/3447703656 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2650697146 0 0) 0x7f642808d930 con 0x7f642808afb0 2023-03-03T07:46:37.063 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.062+0000 7f642c9b2700 1 --2- 172.21.15.57:0/3447703656 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6428095eb0 0x7f6428123480 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f641c0097d0 tx=0x7f641c009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f95a2ef83a1e8f3e server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:37.064 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.062+0000 7f64277fe700 1 -- 172.21.15.57:0/3447703656 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f641c0041c0 con 0x7f6428095eb0 2023-03-03T07:46:37.064 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.062+0000 7f64277fe700 1 -- 172.21.15.57:0/3447703656 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f641c004320 con 0x7f6428095eb0 2023-03-03T07:46:37.064 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.062+0000 7f64277fe700 1 -- 172.21.15.57:0/3447703656 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f641c0036c0 con 0x7f6428095eb0 2023-03-03T07:46:37.065 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.062+0000 7f642d9b4700 1 -- 172.21.15.57:0/3447703656 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6428095eb0 msgr2=0x7f6428123480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:37.066 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.062+0000 7f642d9b4700 1 --2- 172.21.15.57:0/3447703656 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6428095eb0 0x7f6428123480 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f641c0097d0 tx=0x7f641c009ae0 comp rx=0 tx=0).stop 2023-03-03T07:46:37.066 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.062+0000 7f642d9b4700 1 -- 172.21.15.57:0/3447703656 shutdown_connections 2023-03-03T07:46:37.066 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.062+0000 7f642d9b4700 1 --2- 172.21.15.57:0/3447703656 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6428095eb0 0x7f6428123480 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:37.066 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.062+0000 7f642d9b4700 1 -- 172.21.15.57:0/3447703656 >> 172.21.15.57:0/3447703656 conn(0x7f6428094b00 msgr2=0x7f6428094ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:46:37.066 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.062+0000 7f642d9b4700 1 -- 172.21.15.57:0/3447703656 shutdown_connections 2023-03-03T07:46:37.066 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.062+0000 7f642d9b4700 1 -- 172.21.15.57:0/3447703656 wait complete. 2023-03-03T07:46:37.067 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.066+0000 7f642d9b4700 1 Processor -- start 2023-03-03T07:46:37.068 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.066+0000 7f642d9b4700 1 -- start start 2023-03-03T07:46:37.069 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.066+0000 7f642d9b4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f642808afb0 0x7f64281bbf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:37.069 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.066+0000 7f642d9b4700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64281afe90 con 0x7f642808afb0 2023-03-03T07:46:37.069 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.066+0000 7f642c9b2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f642808afb0 0x7f64281bbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:37.070 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.066+0000 7f642c9b2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f642808afb0 0x7f64281bbf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48028/0 (socket says 172.21.15.57:48028) 2023-03-03T07:46:37.070 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.066+0000 7f642c9b2700 1 -- 172.21.15.57:0/2925981241 learned_addr learned my addr 172.21.15.57:0/2925981241 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:46:37.070 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.066+0000 7f642c9b2700 1 -- 172.21.15.57:0/2925981241 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f641c0094b0 con 0x7f642808afb0 2023-03-03T07:46:37.071 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.066+0000 7f642c9b2700 1 --2- 172.21.15.57:0/2925981241 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f642808afb0 0x7f64281bbf90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f641c009b20 tx=0x7f641c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:37.071 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.066+0000 7f64257fa700 1 -- 172.21.15.57:0/2925981241 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f641c006ea0 con 0x7f642808afb0 2023-03-03T07:46:37.071 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.070+0000 7f64257fa700 1 -- 172.21.15.57:0/2925981241 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f641c011760 con 0x7f642808afb0 2023-03-03T07:46:37.072 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.070+0000 7f642d9b4700 1 -- 172.21.15.57:0/2925981241 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6428123bf0 con 0x7f642808afb0 2023-03-03T07:46:37.072 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.070+0000 7f64257fa700 1 -- 172.21.15.57:0/2925981241 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f641c011a00 con 0x7f642808afb0 2023-03-03T07:46:37.072 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.070+0000 7f642d9b4700 1 -- 172.21.15.57:0/2925981241 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6428123a60 con 0x7f642808afb0 2023-03-03T07:46:37.073 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.070+0000 7f642d9b4700 1 -- 172.21.15.57:0/2925981241 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6428123d80 con 0x7f642808afb0 2023-03-03T07:46:37.074 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.070+0000 7f64257fa700 1 -- 172.21.15.57:0/2925981241 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 42245+0+0 (secure 0 0 0) 0x7f641c00f050 con 0x7f642808afb0 2023-03-03T07:46:37.074 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.070+0000 7f64257fa700 1 --2- 172.21.15.57:0/2925981241 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f640c034800 0x7f640c036cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:37.075 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.070+0000 7f64257fa700 1 -- 172.21.15.57:0/2925981241 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 2928+0+0 (secure 0 0 0) 0x7f641c047370 con 0x7f642808afb0 2023-03-03T07:46:37.075 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.074+0000 7f6427fff700 1 --2- 172.21.15.57:0/2925981241 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f640c034800 0x7f640c036cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:37.077 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.074+0000 7f6427fff700 1 --2- 172.21.15.57:0/2925981241 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f640c034800 0x7f640c036cb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6414000c00 tx=0x7f64140079c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:37.083 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.078+0000 7f64257fa700 1 -- 172.21.15.57:0/2925981241 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f641c00b560 con 0x7f642808afb0 2023-03-03T07:46:37.263 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.258+0000 7f642d9b4700 1 -- 172.21.15.57:0/2925981241 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command([{prefix=config set, name=mgr/volumes/snapshot_clone_delay}] v 0) v1 -- 0x7f6428091ff0 con 0x7f642808afb0 2023-03-03T07:46:37.273 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.270+0000 7f64257fa700 1 -- 172.21.15.57:0/2925981241 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/volumes/snapshot_clone_delay}]=0 v3)=0 v3) v1 ==== 131+0+0 (secure 0 0 0) 0x7f641c016030 con 0x7f642808afb0 2023-03-03T07:46:37.377 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.374+0000 7f642d9b4700 1 -- 172.21.15.57:0/2925981241 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command([{prefix=config set, name=mgr/volumes/snapshot_clone_delay}] v 0) v1 -- 0x7f642806a7a0 con 0x7f642808afb0 2023-03-03T07:46:37.378 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.374+0000 7f64257fa700 1 -- 172.21.15.57:0/2925981241 <== mon.0 v2:172.21.15.57:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mgr/volumes/snapshot_clone_delay}]=0 v3)=0 v3) v1 ==== 131+0+0 (secure 0 0 0) 0x7f641c021020 con 0x7f642808afb0 2023-03-03T07:46:37.380 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.378+0000 7f642d9b4700 1 -- 172.21.15.57:0/2925981241 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f640c034800 msgr2=0x7f640c036cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:37.380 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.378+0000 7f642d9b4700 1 --2- 172.21.15.57:0/2925981241 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f640c034800 0x7f640c036cb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6414000c00 tx=0x7f64140079c0 comp rx=0 tx=0).stop 2023-03-03T07:46:37.381 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.378+0000 7f642d9b4700 1 -- 172.21.15.57:0/2925981241 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f642808afb0 msgr2=0x7f64281bbf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:37.381 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.378+0000 7f642d9b4700 1 --2- 172.21.15.57:0/2925981241 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f642808afb0 0x7f64281bbf90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f641c009b20 tx=0x7f641c004770 comp rx=0 tx=0).stop 2023-03-03T07:46:37.382 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.378+0000 7f642d9b4700 1 -- 172.21.15.57:0/2925981241 shutdown_connections 2023-03-03T07:46:37.382 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.378+0000 7f642d9b4700 1 --2- 172.21.15.57:0/2925981241 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f640c034800 0x7f640c036cb0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:37.382 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.378+0000 7f642d9b4700 1 --2- 172.21.15.57:0/2925981241 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f642808afb0 0x7f64281bbf90 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:37.383 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.378+0000 7f642d9b4700 1 -- 172.21.15.57:0/2925981241 >> 172.21.15.57:0/2925981241 conn(0x7f6428094b00 msgr2=0x7f6428091340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:46:37.383 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.378+0000 7f642d9b4700 1 -- 172.21.15.57:0/2925981241 shutdown_connections 2023-03-03T07:46:37.383 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.378+0000 7f642d9b4700 1 -- 172.21.15.57:0/2925981241 wait complete. 2023-03-03T07:46:37.416 INFO:tasks.workunit.client.0.smithi057.stderr:++ eval echo '{1..10}' 2023-03-03T07:46:37.416 INFO:tasks.workunit.client.0.smithi057.stderr:+++ echo 1 2 3 4 5 6 7 8 9 10 2023-03-03T07:46:37.417 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in $(eval echo {1..$NUM_CLONES}) 2023-03-03T07:46:37.418 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph fs subvolume snapshot clone cephfs sub_0 snap_0 clone_1 2023-03-03T07:46:37.594 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.590+0000 7f122d723700 1 Processor -- start 2023-03-03T07:46:37.594 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.590+0000 7f122d723700 1 -- start start 2023-03-03T07:46:37.596 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.594+0000 7f122d723700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f122808e4c0 0x7f122808e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:37.597 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.594+0000 7f122d723700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f122808f8e0 con 0x7f122808edd0 2023-03-03T07:46:37.597 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.594+0000 7f122d723700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f122808f760 con 0x7f122808e4c0 2023-03-03T07:46:37.598 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.594+0000 7f1227fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f122808e4c0 0x7f122808e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:37.598 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.594+0000 7f12277fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f122808edd0 0x7f12281246b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:40980/0 (socket says 172.21.15.57:40980) 2023-03-03T07:46:37.598 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.594+0000 7f12277fe700 1 -- 172.21.15.57:0/3436526282 learned_addr learned my addr 172.21.15.57:0/3436526282 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:46:37.599 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.594+0000 7f1226ffd700 1 -- 172.21.15.57:0/3436526282 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3524674571 0 0) 0x7f122808f8e0 con 0x7f122808edd0 2023-03-03T07:46:37.599 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.594+0000 7f1227fff700 1 -- 172.21.15.57:0/3436526282 >> v1:172.21.15.57:6789/0 conn(0x7f122808edd0 legacy=0x7f12281246b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:37.599 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.594+0000 7f1227fff700 1 -- 172.21.15.57:0/3436526282 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1228090650 con 0x7f122808e4c0 2023-03-03T07:46:37.600 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.598+0000 7f1227fff700 1 --2- 172.21.15.57:0/3436526282 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f122808e4c0 0x7f122808e890 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1218009d90 tx=0x7f121800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d8120fb9b34dcc3 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:37.600 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.598+0000 7f1226ffd700 1 -- 172.21.15.57:0/3436526282 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f121800e070 con 0x7f122808e4c0 2023-03-03T07:46:37.601 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.598+0000 7f1226ffd700 1 -- 172.21.15.57:0/3436526282 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f121800bc80 con 0x7f122808e4c0 2023-03-03T07:46:37.601 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.598+0000 7f1226ffd700 1 -- 172.21.15.57:0/3436526282 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1218003a40 con 0x7f122808e4c0 2023-03-03T07:46:37.601 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.598+0000 7f122d723700 1 -- 172.21.15.57:0/3436526282 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f122808e4c0 msgr2=0x7f122808e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:37.602 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.598+0000 7f122d723700 1 --2- 172.21.15.57:0/3436526282 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f122808e4c0 0x7f122808e890 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1218009d90 tx=0x7f121800b330 comp rx=0 tx=0).stop 2023-03-03T07:46:37.602 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.598+0000 7f122d723700 1 -- 172.21.15.57:0/3436526282 shutdown_connections 2023-03-03T07:46:37.602 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.598+0000 7f122d723700 1 --2- 172.21.15.57:0/3436526282 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f122808e4c0 0x7f122808e890 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:37.602 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.598+0000 7f122d723700 1 -- 172.21.15.57:0/3436526282 >> 172.21.15.57:0/3436526282 conn(0x7f1228089fa0 msgr2=0x7f122808c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:46:37.602 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.598+0000 7f122d723700 1 -- 172.21.15.57:0/3436526282 shutdown_connections 2023-03-03T07:46:37.602 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.598+0000 7f122d723700 1 -- 172.21.15.57:0/3436526282 wait complete. 2023-03-03T07:46:37.603 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.602+0000 7f122d723700 1 Processor -- start 2023-03-03T07:46:37.603 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.602+0000 7f122d723700 1 -- start start 2023-03-03T07:46:37.604 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.602+0000 7f122d723700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f122808e4c0 0x7f12281bc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:37.604 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.602+0000 7f122d723700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1228124610 con 0x7f122808e4c0 2023-03-03T07:46:37.605 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.602+0000 7f1227fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f122808e4c0 0x7f12281bc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:37.605 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.602+0000 7f1227fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f122808e4c0 0x7f12281bc1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48042/0 (socket says 172.21.15.57:48042) 2023-03-03T07:46:37.605 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.602+0000 7f1227fff700 1 -- 172.21.15.57:0/3199576085 learned_addr learned my addr 172.21.15.57:0/3199576085 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:46:37.606 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.602+0000 7f1227fff700 1 -- 172.21.15.57:0/3199576085 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1218009a70 con 0x7f122808e4c0 2023-03-03T07:46:37.606 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.602+0000 7f1227fff700 1 --2- 172.21.15.57:0/3199576085 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f122808e4c0 0x7f12281bc1f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f12280677f0 tx=0x7f1218004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:37.606 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.602+0000 7f1224ff9700 1 -- 172.21.15.57:0/3199576085 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1218004840 con 0x7f122808e4c0 2023-03-03T07:46:37.607 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.602+0000 7f1224ff9700 1 -- 172.21.15.57:0/3199576085 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1218012430 con 0x7f122808e4c0 2023-03-03T07:46:37.607 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.602+0000 7f1224ff9700 1 -- 172.21.15.57:0/3199576085 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12180126f0 con 0x7f122808e4c0 2023-03-03T07:46:37.607 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.602+0000 7f122d723700 1 -- 172.21.15.57:0/3199576085 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12281251a0 con 0x7f122808e4c0 2023-03-03T07:46:37.607 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.606+0000 7f122d723700 1 -- 172.21.15.57:0/3199576085 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1228125010 con 0x7f122808e4c0 2023-03-03T07:46:37.610 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.606+0000 7f1224ff9700 1 -- 172.21.15.57:0/3199576085 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 42245+0+0 (secure 0 0 0) 0x7f1218012850 con 0x7f122808e4c0 2023-03-03T07:46:37.610 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.606+0000 7f122d723700 1 -- 172.21.15.57:0/3199576085 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1228125330 con 0x7f122808e4c0 2023-03-03T07:46:37.611 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.610+0000 7f1224ff9700 1 --2- 172.21.15.57:0/3199576085 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f12140347f0 0x7f1214036ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:37.611 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.610+0000 7f1224ff9700 1 -- 172.21.15.57:0/3199576085 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 2928+0+0 (secure 0 0 0) 0x7f12180487f0 con 0x7f122808e4c0 2023-03-03T07:46:37.612 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.610+0000 7f12277fe700 1 --2- 172.21.15.57:0/3199576085 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f12140347f0 0x7f1214036ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:37.613 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.610+0000 7f12277fe700 1 --2- 172.21.15.57:0/3199576085 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f12140347f0 0x7f1214036ca0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f121c000c00 tx=0x7f121c007a20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:37.618 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.614+0000 7f1224ff9700 1 -- 172.21.15.57:0/3199576085 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f121801cd80 con 0x7f122808e4c0 2023-03-03T07:46:37.822 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.818+0000 7f122d723700 1 -- 172.21.15.57:0/3199576085 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sub_0", "snap_name": "snap_0", "target_sub_name": "clone_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f122811cfb0 con 0x7f12140347f0 2023-03-03T07:46:37.941 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:37.938+0000 7f1224ff9700 1 -- 172.21.15.57:0/3199576085 <== mgr.4099 v2:172.21.15.57:6808/28565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f122811cfb0 con 0x7f12140347f0 2023-03-03T07:46:37.948 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:46:37.946+0000 7fde4bad7700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-03T07:46:37.948 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:46:37.946+0000 7fde4bad7700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-03T07:46:37.949 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:46:37.946+0000 7fde4bad7700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-03T07:46:37.949 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:46:37.946+0000 7fde4bad7700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-03T07:46:37.949 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:46:37.946+0000 7fde4bad7700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-03T07:46:37.978 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:46:37.974+0000 7fde4b2d6700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-03T07:46:37.978 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:46:37.974+0000 7fde4b2d6700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-03T07:46:37.978 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:46:37.974+0000 7fde4b2d6700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-03T07:46:37.979 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:46:37.974+0000 7fde4b2d6700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-03T07:46:37.979 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:46:37.974+0000 7fde4b2d6700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-03T07:46:38.086 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:38.082+0000 7f122d723700 1 -- 172.21.15.57:0/3199576085 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 1: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sub_0", "snap_name": "snap_0", "target_sub_name": "clone_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f122806d630 con 0x7f12140347f0 2023-03-03T07:46:38.109 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:46:38.106+0000 7fde62304700 -1 mgr.server reply reply (17) File exists subvolume 'clone_1' exists 2023-03-03T07:46:38.109 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:38.106+0000 7f1224ff9700 1 -- 172.21.15.57:0/3199576085 <== mgr.4099 v2:172.21.15.57:6808/28565 2 ==== mgr_command_reply(tid 1: -17 subvolume 'clone_1' exists) v1 ==== 34+0+0 (secure 0 0 0) 0x7f122806d630 con 0x7f12140347f0 2023-03-03T07:46:38.113 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:38.110+0000 7f122d723700 1 -- 172.21.15.57:0/3199576085 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f12140347f0 msgr2=0x7f1214036ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:38.113 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:38.110+0000 7f122d723700 1 --2- 172.21.15.57:0/3199576085 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f12140347f0 0x7f1214036ca0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f121c000c00 tx=0x7f121c007a20 comp rx=0 tx=0).stop 2023-03-03T07:46:38.113 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:38.110+0000 7f122d723700 1 -- 172.21.15.57:0/3199576085 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f122808e4c0 msgr2=0x7f12281bc1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:38.114 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:38.110+0000 7f122d723700 1 --2- 172.21.15.57:0/3199576085 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f122808e4c0 0x7f12281bc1f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f12280677f0 tx=0x7f1218004af0 comp rx=0 tx=0).stop 2023-03-03T07:46:38.114 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:38.110+0000 7f122d723700 1 -- 172.21.15.57:0/3199576085 shutdown_connections 2023-03-03T07:46:38.114 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:38.110+0000 7f122d723700 1 --2- 172.21.15.57:0/3199576085 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f12140347f0 0x7f1214036ca0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:38.114 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:38.110+0000 7f122d723700 1 --2- 172.21.15.57:0/3199576085 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f122808e4c0 0x7f12281bc1f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:38.114 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:38.110+0000 7f122d723700 1 -- 172.21.15.57:0/3199576085 >> 172.21.15.57:0/3199576085 conn(0x7f1228089fa0 msgr2=0x7f12281ac9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:46:38.115 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:38.110+0000 7f122d723700 1 -- 172.21.15.57:0/3199576085 shutdown_connections 2023-03-03T07:46:38.115 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:38.110+0000 7f122d723700 1 -- 172.21.15.57:0/3199576085 wait complete. 2023-03-03T07:46:38.117 INFO:tasks.workunit.client.0.smithi057.stderr:Second attempt of previously successful command failed with EEXIST: subvolume 'clone_1' exists 2023-03-03T07:46:38.117 INFO:tasks.workunit.client.0.smithi057.stderr:subvolume 'clone_1' exists 2023-03-03T07:46:38.141 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in $(eval echo {1..$NUM_CLONES}) 2023-03-03T07:46:38.141 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph fs subvolume snapshot clone cephfs sub_0 snap_0 clone_2 2023-03-03T07:46:38.319 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:38.314+0000 7fd095403700 1 Processor -- start 2023-03-03T07:46:38.320 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:38.318+0000 7fd095403700 1 -- start start 2023-03-03T07:46:38.320 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:38.318+0000 7fd095403700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd090123850 0x7fd090123c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:38.321 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:38.318+0000 7fd095403700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd09006b770 con 0x7fd090123170 2023-03-03T07:46:38.321 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:38.318+0000 7fd095403700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd090071e80 con 0x7fd090123850 2023-03-03T07:46:38.321 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:38.318+0000 7fd08effd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd090123850 0x7fd090123c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:38.322 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:38.318+0000 7fd08e7fc700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fd090123170 0x7fd0901220f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:40990/0 (socket says 172.21.15.57:40990) 2023-03-03T07:46:38.322 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:38.318+0000 7fd08e7fc700 1 -- 172.21.15.57:0/623107627 learned_addr learned my addr 172.21.15.57:0/623107627 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:46:38.322 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:38.318+0000 7fd08effd700 1 -- 172.21.15.57:0/623107627 >> v1:172.21.15.57:6789/0 conn(0x7fd090123170 legacy=0x7fd0901220f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:38.323 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:38.318+0000 7fd08effd700 1 -- 172.21.15.57:0/623107627 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd090122800 con 0x7fd090123850 2023-03-03T07:46:38.324 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:38.322+0000 7fd08effd700 1 --2- 172.21.15.57:0/623107627 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd090123850 0x7fd090123c20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd0800097d0 tx=0x7fd080009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae883d4e2ac362c3 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:38.325 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:38.322+0000 7fd08dffb700 1 -- 172.21.15.57:0/623107627 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd0800041c0 con 0x7fd090123850 2023-03-03T07:46:38.325 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:38.322+0000 7fd08dffb700 1 -- 172.21.15.57:0/623107627 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd080004320 con 0x7fd090123850 2023-03-03T07:46:38.325 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:38.322+0000 7fd08dffb700 1 -- 172.21.15.57:0/623107627 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd0800036c0 con 0x7fd090123850 2023-03-03T07:46:38.326 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:38.322+0000 7fd095403700 1 -- 172.21.15.57:0/623107627 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd090123850 msgr2=0x7fd090123c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:38.326 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:38.322+0000 7fd095403700 1 --2- 172.21.15.57:0/623107627 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd090123850 0x7fd090123c20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd0800097d0 tx=0x7fd080009ae0 comp rx=0 tx=0).stop 2023-03-03T07:46:38.326 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:38.322+0000 7fd095403700 1 -- 172.21.15.57:0/623107627 shutdown_connections 2023-03-03T07:46:38.326 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:38.322+0000 7fd095403700 1 --2- 172.21.15.57:0/623107627 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd090123850 0x7fd090123c20 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:38.326 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:38.322+0000 7fd095403700 1 -- 172.21.15.57:0/623107627 >> 172.21.15.57:0/623107627 conn(0x7fd090069f80 msgr2=0x7fd09006a380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:46:38.326 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:38.322+0000 7fd095403700 1 -- 172.21.15.57:0/623107627 shutdown_connections 2023-03-03T07:46:38.326 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:38.322+0000 7fd095403700 1 -- 172.21.15.57:0/623107627 wait complete. 2023-03-03T07:46:38.328 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:38.326+0000 7fd095403700 1 Processor -- start 2023-03-03T07:46:38.328 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:38.326+0000 7fd095403700 1 -- start start 2023-03-03T07:46:38.329 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:38.326+0000 7fd095403700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd090123170 0x7fd09011e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:38.329 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:38.326+0000 7fd095403700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd090120b70 con 0x7fd090123170 2023-03-03T07:46:38.330 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:38.326+0000 7fd08effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd090123170 0x7fd09011e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:38.330 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:38.326+0000 7fd08effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd090123170 0x7fd09011e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48080/0 (socket says 172.21.15.57:48080) 2023-03-03T07:46:38.330 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:38.326+0000 7fd08effd700 1 -- 172.21.15.57:0/3185772619 learned_addr learned my addr 172.21.15.57:0/3185772619 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:46:38.330 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:38.326+0000 7fd08effd700 1 -- 172.21.15.57:0/3185772619 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0800094b0 con 0x7fd090123170 2023-03-03T07:46:38.331 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:38.330+0000 7fd08effd700 1 --2- 172.21.15.57:0/3185772619 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd090123170 0x7fd09011e020 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd080009b20 tx=0x7fd080004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:38.332 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:38.330+0000 7fd0777fe700 1 -- 172.21.15.57:0/3185772619 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd080006ea0 con 0x7fd090123170 2023-03-03T07:46:38.332 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:38.330+0000 7fd0777fe700 1 -- 172.21.15.57:0/3185772619 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd080011630 con 0x7fd090123170 2023-03-03T07:46:38.332 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:38.330+0000 7fd0777fe700 1 -- 172.21.15.57:0/3185772619 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd0800118d0 con 0x7fd090123170 2023-03-03T07:46:38.333 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:38.330+0000 7fd095403700 1 -- 172.21.15.57:0/3185772619 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd090122dd0 con 0x7fd090123170 2023-03-03T07:46:38.333 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:38.330+0000 7fd095403700 1 -- 172.21.15.57:0/3185772619 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd090122c40 con 0x7fd090123170 2023-03-03T07:46:38.335 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:38.330+0000 7fd095403700 1 -- 172.21.15.57:0/3185772619 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd090122f60 con 0x7fd090123170 2023-03-03T07:46:38.335 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:38.334+0000 7fd0777fe700 1 -- 172.21.15.57:0/3185772619 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 42245+0+0 (secure 0 0 0) 0x7fd08000f050 con 0x7fd090123170 2023-03-03T07:46:38.336 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:38.334+0000 7fd0777fe700 1 --2- 172.21.15.57:0/3185772619 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fd07c034800 0x7fd07c036cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:38.336 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:38.334+0000 7fd0777fe700 1 -- 172.21.15.57:0/3185772619 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 2928+0+0 (secure 0 0 0) 0x7fd080047350 con 0x7fd090123170 2023-03-03T07:46:38.337 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:38.334+0000 7fd08e7fc700 1 --2- 172.21.15.57:0/3185772619 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fd07c034800 0x7fd07c036cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:38.338 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:38.334+0000 7fd08e7fc700 1 --2- 172.21.15.57:0/3185772619 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fd07c034800 0x7fd07c036cb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd0840016a0 tx=0x7fd084007b70 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:38.344 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:38.342+0000 7fd0777fe700 1 -- 172.21.15.57:0/3185772619 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd090122f60 con 0x7fd090123170 2023-03-03T07:46:38.561 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:38.558+0000 7fd095403700 1 -- 172.21.15.57:0/3185772619 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sub_0", "snap_name": "snap_0", "target_sub_name": "clone_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fd090122f60 con 0x7fd07c034800 2023-03-03T07:46:38.656 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:38.654+0000 7fd0777fe700 1 -- 172.21.15.57:0/3185772619 <== mgr.4099 v2:172.21.15.57:6808/28565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fd090122f60 con 0x7fd07c034800 2023-03-03T07:46:38.794 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:38.790+0000 7fd095403700 1 -- 172.21.15.57:0/3185772619 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 1: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sub_0", "snap_name": "snap_0", "target_sub_name": "clone_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fd0900619b0 con 0x7fd07c034800 2023-03-03T07:46:39.349 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:39.346+0000 7fd0777fe700 1 -- 172.21.15.57:0/3185772619 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mgrmap(e 9) v1 ==== 42325+0+0 (secure 0 0 0) 0x7fd08001d450 con 0x7fd090123170 2023-03-03T07:46:40.054 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:46:40.050+0000 7fde62304700 -1 mgr.server reply reply (17) File exists subvolume 'clone_2' exists 2023-03-03T07:46:40.054 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:40.050+0000 7fd0777fe700 1 -- 172.21.15.57:0/3185772619 <== mgr.4099 v2:172.21.15.57:6808/28565 2 ==== mgr_command_reply(tid 1: -17 subvolume 'clone_2' exists) v1 ==== 34+0+0 (secure 0 0 0) 0x7fd0900619b0 con 0x7fd07c034800 2023-03-03T07:46:40.058 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:40.054+0000 7fd095403700 1 -- 172.21.15.57:0/3185772619 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fd07c034800 msgr2=0x7fd07c036cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:40.059 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:40.054+0000 7fd095403700 1 --2- 172.21.15.57:0/3185772619 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fd07c034800 0x7fd07c036cb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd0840016a0 tx=0x7fd084007b70 comp rx=0 tx=0).stop 2023-03-03T07:46:40.059 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:40.054+0000 7fd095403700 1 -- 172.21.15.57:0/3185772619 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd090123170 msgr2=0x7fd09011e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:40.059 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:40.054+0000 7fd095403700 1 --2- 172.21.15.57:0/3185772619 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd090123170 0x7fd09011e020 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd080009b20 tx=0x7fd080004770 comp rx=0 tx=0).stop 2023-03-03T07:46:40.059 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:40.054+0000 7fd095403700 1 -- 172.21.15.57:0/3185772619 shutdown_connections 2023-03-03T07:46:40.060 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:40.054+0000 7fd095403700 1 --2- 172.21.15.57:0/3185772619 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fd07c034800 0x7fd07c036cb0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:40.060 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:40.054+0000 7fd095403700 1 --2- 172.21.15.57:0/3185772619 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd090123170 0x7fd09011e020 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:40.060 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:40.054+0000 7fd095403700 1 -- 172.21.15.57:0/3185772619 >> 172.21.15.57:0/3185772619 conn(0x7fd090069f80 msgr2=0x7fd0900715c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:46:40.060 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:40.058+0000 7fd095403700 1 -- 172.21.15.57:0/3185772619 shutdown_connections 2023-03-03T07:46:40.060 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:40.058+0000 7fd095403700 1 -- 172.21.15.57:0/3185772619 wait complete. 2023-03-03T07:46:40.062 INFO:tasks.workunit.client.0.smithi057.stderr:Second attempt of previously successful command failed with EEXIST: subvolume 'clone_2' exists 2023-03-03T07:46:40.062 INFO:tasks.workunit.client.0.smithi057.stderr:subvolume 'clone_2' exists 2023-03-03T07:46:40.085 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in $(eval echo {1..$NUM_CLONES}) 2023-03-03T07:46:40.085 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph fs subvolume snapshot clone cephfs sub_0 snap_0 clone_3 2023-03-03T07:46:40.268 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:40.266+0000 7f2ced970700 1 Processor -- start 2023-03-03T07:46:40.268 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:40.266+0000 7f2ced970700 1 -- start start 2023-03-03T07:46:40.270 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:40.266+0000 7f2ced970700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2ce808e840 0x7f2ce81294c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:40.270 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:40.266+0000 7f2ced970700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ce808e530 con 0x7f2ce808f020 2023-03-03T07:46:40.271 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:40.266+0000 7f2ced970700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ce812aa10 con 0x7f2ce808e840 2023-03-03T07:46:40.271 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:40.270+0000 7f2cec96e700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f2ce808f020 0x7f2ce808f3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53770/0 (socket says 172.21.15.57:53770) 2023-03-03T07:46:40.271 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:40.270+0000 7f2cec96e700 1 -- 172.21.15.57:0/404552048 learned_addr learned my addr 172.21.15.57:0/404552048 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:46:40.272 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:40.270+0000 7f2ce7fff700 1 --2- 172.21.15.57:0/404552048 >> v2:172.21.15.57:3300/0 conn(0x7f2ce808e840 0x7f2ce81294c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:40.272 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:40.270+0000 7f2ce77fe700 1 -- 172.21.15.57:0/404552048 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1651501379 0 0) 0x7f2ce808e530 con 0x7f2ce808f020 2023-03-03T07:46:40.273 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:40.270+0000 7f2ce77fe700 1 -- 172.21.15.57:0/404552048 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cd80035d0 con 0x7f2ce808f020 2023-03-03T07:46:40.273 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:40.270+0000 7f2ce7fff700 1 -- 172.21.15.57:0/404552048 >> v1:172.21.15.57:6789/0 conn(0x7f2ce808f020 legacy=0x7f2ce808f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:40.273 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:40.270+0000 7f2ce7fff700 1 -- 172.21.15.57:0/404552048 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce812ab50 con 0x7f2ce808e840 2023-03-03T07:46:40.273 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:40.270+0000 7f2ce7fff700 1 --2- 172.21.15.57:0/404552048 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ce808e840 0x7f2ce81294c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2cd40097d0 tx=0x7f2cd4009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68a17f2262bf1b0b server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:40.274 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:40.270+0000 7f2ce77fe700 1 -- 172.21.15.57:0/404552048 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2cd4004160 con 0x7f2ce808e840 2023-03-03T07:46:40.274 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:40.270+0000 7f2ce77fe700 1 -- 172.21.15.57:0/404552048 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cd40042c0 con 0x7f2ce808e840 2023-03-03T07:46:40.274 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:40.270+0000 7f2ce77fe700 1 -- 172.21.15.57:0/404552048 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2cd40045a0 con 0x7f2ce808e840 2023-03-03T07:46:40.275 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:40.270+0000 7f2ced970700 1 -- 172.21.15.57:0/404552048 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ce808e840 msgr2=0x7f2ce81294c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:40.275 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:40.270+0000 7f2ced970700 1 --2- 172.21.15.57:0/404552048 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ce808e840 0x7f2ce81294c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2cd40097d0 tx=0x7f2cd4009ae0 comp rx=0 tx=0).stop 2023-03-03T07:46:40.275 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:40.274+0000 7f2ced970700 1 -- 172.21.15.57:0/404552048 shutdown_connections 2023-03-03T07:46:40.276 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:40.274+0000 7f2ced970700 1 --2- 172.21.15.57:0/404552048 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ce808e840 0x7f2ce81294c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:40.276 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:40.274+0000 7f2ced970700 1 -- 172.21.15.57:0/404552048 >> 172.21.15.57:0/404552048 conn(0x7f2ce8094b00 msgr2=0x7f2ce8094ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:46:40.276 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:40.274+0000 7f2ced970700 1 -- 172.21.15.57:0/404552048 shutdown_connections 2023-03-03T07:46:40.276 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:40.274+0000 7f2ced970700 1 -- 172.21.15.57:0/404552048 wait complete. 2023-03-03T07:46:40.278 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:40.274+0000 7f2ced970700 1 Processor -- start 2023-03-03T07:46:40.278 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:40.274+0000 7f2ced970700 1 -- start start 2023-03-03T07:46:40.280 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:40.278+0000 7f2ced970700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ce808e840 0x7f2ce811e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:40.280 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:40.278+0000 7f2ced970700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce8121100 con 0x7f2ce808e840 2023-03-03T07:46:40.280 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:40.278+0000 7f2cec96e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ce808e840 0x7f2ce811e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:40.280 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:40.278+0000 7f2cec96e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ce808e840 0x7f2ce811e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34644/0 (socket says 172.21.15.57:34644) 2023-03-03T07:46:40.281 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:40.278+0000 7f2cec96e700 1 -- 172.21.15.57:0/1612398079 learned_addr learned my addr 172.21.15.57:0/1612398079 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:46:40.281 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:40.278+0000 7f2cec96e700 1 -- 172.21.15.57:0/1612398079 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd40094b0 con 0x7f2ce808e840 2023-03-03T07:46:40.282 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:40.278+0000 7f2cec96e700 1 --2- 172.21.15.57:0/1612398079 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ce808e840 0x7f2ce811e750 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc00c680 tx=0x7f2cdc00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:40.282 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:40.278+0000 7f2ce57fa700 1 -- 172.21.15.57:0/1612398079 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2cdc005cc0 con 0x7f2ce808e840 2023-03-03T07:46:40.283 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:40.278+0000 7f2ce57fa700 1 -- 172.21.15.57:0/1612398079 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cdc005e20 con 0x7f2ce808e840 2023-03-03T07:46:40.283 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:40.278+0000 7f2ce57fa700 1 -- 172.21.15.57:0/1612398079 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2cdc007220 con 0x7f2ce808e840 2023-03-03T07:46:40.283 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:40.278+0000 7f2ced970700 1 -- 172.21.15.57:0/1612398079 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ce8129de0 con 0x7f2ce808e840 2023-03-03T07:46:40.283 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:40.282+0000 7f2ced970700 1 -- 172.21.15.57:0/1612398079 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ce8129c50 con 0x7f2ce808e840 2023-03-03T07:46:40.285 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:40.282+0000 7f2ce57fa700 1 -- 172.21.15.57:0/1612398079 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 9) v1 ==== 42325+0+0 (secure 0 0 0) 0x7f2cdc019030 con 0x7f2ce808e840 2023-03-03T07:46:40.285 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:40.282+0000 7f2ced970700 1 -- 172.21.15.57:0/1612398079 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ce8129f70 con 0x7f2ce808e840 2023-03-03T07:46:40.286 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:40.282+0000 7f2ce57fa700 1 --2- 172.21.15.57:0/1612398079 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f2ccc034910 0x7f2ccc036dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:40.287 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:40.282+0000 7f2ce57fa700 1 -- 172.21.15.57:0/1612398079 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 2928+0+0 (secure 0 0 0) 0x7f2cdc045730 con 0x7f2ce808e840 2023-03-03T07:46:40.287 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:40.286+0000 7f2ce7fff700 1 --2- 172.21.15.57:0/1612398079 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f2ccc034910 0x7f2ccc036dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:40.288 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:40.286+0000 7f2ce7fff700 1 --2- 172.21.15.57:0/1612398079 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f2ccc034910 0x7f2ccc036dc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2cd4006ee0 tx=0x7f2cd4008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:40.294 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:40.290+0000 7f2ce57fa700 1 -- 172.21.15.57:0/1612398079 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f2cdc0196b0 con 0x7f2ce808e840 2023-03-03T07:46:40.510 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:40.506+0000 7f2ced970700 1 -- 172.21.15.57:0/1612398079 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sub_0", "snap_name": "snap_0", "target_sub_name": "clone_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ce80619b0 con 0x7f2ccc034910 2023-03-03T07:46:40.600 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:40.598+0000 7f2ce57fa700 1 -- 172.21.15.57:0/1612398079 <== mgr.4099 v2:172.21.15.57:6808/28565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f2ce80619b0 con 0x7f2ccc034910 2023-03-03T07:46:40.737 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:40.734+0000 7f2ced970700 1 -- 172.21.15.57:0/1612398079 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 1: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sub_0", "snap_name": "snap_0", "target_sub_name": "clone_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ce8000980 con 0x7f2ccc034910 2023-03-03T07:46:45.055 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:46:45.054+0000 7fde62304700 -1 mgr.server reply reply (17) File exists subvolume 'clone_3' exists 2023-03-03T07:46:45.056 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:45.054+0000 7f2ce57fa700 1 -- 172.21.15.57:0/1612398079 <== mgr.4099 v2:172.21.15.57:6808/28565 2 ==== mgr_command_reply(tid 1: -17 subvolume 'clone_3' exists) v1 ==== 34+0+0 (secure 0 0 0) 0x7f2ce8000980 con 0x7f2ccc034910 2023-03-03T07:46:45.061 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:45.058+0000 7f2ced970700 1 -- 172.21.15.57:0/1612398079 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f2ccc034910 msgr2=0x7f2ccc036dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:45.061 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:45.058+0000 7f2ced970700 1 --2- 172.21.15.57:0/1612398079 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f2ccc034910 0x7f2ccc036dc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2cd4006ee0 tx=0x7f2cd4008030 comp rx=0 tx=0).stop 2023-03-03T07:46:45.061 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:45.058+0000 7f2ced970700 1 -- 172.21.15.57:0/1612398079 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ce808e840 msgr2=0x7f2ce811e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:45.062 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:45.058+0000 7f2ced970700 1 --2- 172.21.15.57:0/1612398079 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ce808e840 0x7f2ce811e750 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc00c680 tx=0x7f2cdc00ca40 comp rx=0 tx=0).stop 2023-03-03T07:46:45.062 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:45.058+0000 7f2ced970700 1 -- 172.21.15.57:0/1612398079 shutdown_connections 2023-03-03T07:46:45.062 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:45.058+0000 7f2ced970700 1 --2- 172.21.15.57:0/1612398079 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f2ccc034910 0x7f2ccc036dc0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:45.062 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:45.058+0000 7f2ced970700 1 --2- 172.21.15.57:0/1612398079 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ce808e840 0x7f2ce811e750 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:45.063 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:45.058+0000 7f2ced970700 1 -- 172.21.15.57:0/1612398079 >> 172.21.15.57:0/1612398079 conn(0x7f2ce8094b00 msgr2=0x7f2ce8125290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:46:45.063 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:45.058+0000 7f2ced970700 1 -- 172.21.15.57:0/1612398079 shutdown_connections 2023-03-03T07:46:45.063 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:45.058+0000 7f2ced970700 1 -- 172.21.15.57:0/1612398079 wait complete. 2023-03-03T07:46:45.066 INFO:tasks.workunit.client.0.smithi057.stderr:Second attempt of previously successful command failed with EEXIST: subvolume 'clone_3' exists 2023-03-03T07:46:45.066 INFO:tasks.workunit.client.0.smithi057.stderr:subvolume 'clone_3' exists 2023-03-03T07:46:45.092 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in $(eval echo {1..$NUM_CLONES}) 2023-03-03T07:46:45.092 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph fs subvolume snapshot clone cephfs sub_0 snap_0 clone_4 2023-03-03T07:46:45.269 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:45.266+0000 7fa465f09700 1 Processor -- start 2023-03-03T07:46:45.270 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:45.266+0000 7fa465f09700 1 -- start start 2023-03-03T07:46:45.271 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:45.270+0000 7fa465f09700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa460123c90 0x7fa460122870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:45.272 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:45.270+0000 7fa465f09700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa46006a400 con 0x7fa4601238c0 2023-03-03T07:46:45.272 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:45.270+0000 7fa465f09700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa46006f300 con 0x7fa460123c90 2023-03-03T07:46:45.272 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:45.270+0000 7fa464f07700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa4601238c0 0x7fa460122160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53780/0 (socket says 172.21.15.57:53780) 2023-03-03T07:46:45.273 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:45.270+0000 7fa464f07700 1 -- 172.21.15.57:0/1934074918 learned_addr learned my addr 172.21.15.57:0/1934074918 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:46:45.273 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:45.270+0000 7fa45ffff700 1 --2- 172.21.15.57:0/1934074918 >> v2:172.21.15.57:3300/0 conn(0x7fa460123c90 0x7fa460122870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:45.273 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:45.270+0000 7fa45f7fe700 1 -- 172.21.15.57:0/1934074918 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3932281668 0 0) 0x7fa46006a400 con 0x7fa4601238c0 2023-03-03T07:46:45.274 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:45.270+0000 7fa45f7fe700 1 -- 172.21.15.57:0/1934074918 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4500035d0 con 0x7fa4601238c0 2023-03-03T07:46:45.274 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:45.270+0000 7fa45ffff700 1 -- 172.21.15.57:0/1934074918 >> v1:172.21.15.57:6789/0 conn(0x7fa4601238c0 legacy=0x7fa460122160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:45.274 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:45.270+0000 7fa45ffff700 1 -- 172.21.15.57:0/1934074918 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa460122db0 con 0x7fa460123c90 2023-03-03T07:46:45.274 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:45.270+0000 7fa45ffff700 1 --2- 172.21.15.57:0/1934074918 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa460123c90 0x7fa460122870 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa44c0097d0 tx=0x7fa44c009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77ba297edf0dbec4 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:45.275 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:45.274+0000 7fa45f7fe700 1 -- 172.21.15.57:0/1934074918 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa44c004160 con 0x7fa460123c90 2023-03-03T07:46:45.275 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:45.274+0000 7fa45f7fe700 1 -- 172.21.15.57:0/1934074918 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa44c0042c0 con 0x7fa460123c90 2023-03-03T07:46:45.276 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:45.274+0000 7fa45f7fe700 1 -- 172.21.15.57:0/1934074918 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa44c0045a0 con 0x7fa460123c90 2023-03-03T07:46:45.276 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:45.274+0000 7fa465f09700 1 -- 172.21.15.57:0/1934074918 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa460123c90 msgr2=0x7fa460122870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:45.276 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:45.274+0000 7fa465f09700 1 --2- 172.21.15.57:0/1934074918 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa460123c90 0x7fa460122870 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa44c0097d0 tx=0x7fa44c009ae0 comp rx=0 tx=0).stop 2023-03-03T07:46:45.277 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:45.274+0000 7fa465f09700 1 -- 172.21.15.57:0/1934074918 shutdown_connections 2023-03-03T07:46:45.277 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:45.274+0000 7fa465f09700 1 --2- 172.21.15.57:0/1934074918 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa460123c90 0x7fa460122870 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:45.277 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:45.274+0000 7fa465f09700 1 -- 172.21.15.57:0/1934074918 >> 172.21.15.57:0/1934074918 conn(0x7fa4600948c0 msgr2=0x7fa460096cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:46:45.277 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:45.274+0000 7fa465f09700 1 -- 172.21.15.57:0/1934074918 shutdown_connections 2023-03-03T07:46:45.277 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:45.274+0000 7fa465f09700 1 -- 172.21.15.57:0/1934074918 wait complete. 2023-03-03T07:46:45.278 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:45.274+0000 7fa465f09700 1 Processor -- start 2023-03-03T07:46:45.279 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:45.274+0000 7fa465f09700 1 -- start start 2023-03-03T07:46:45.280 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:45.278+0000 7fa465f09700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4601238c0 0x7fa46011ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:45.280 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:45.278+0000 7fa465f09700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46011e2b0 con 0x7fa4601238c0 2023-03-03T07:46:45.280 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:45.278+0000 7fa464f07700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4601238c0 0x7fa46011ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:45.281 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:45.278+0000 7fa464f07700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4601238c0 0x7fa46011ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34670/0 (socket says 172.21.15.57:34670) 2023-03-03T07:46:45.281 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:45.278+0000 7fa464f07700 1 -- 172.21.15.57:0/4265435012 learned_addr learned my addr 172.21.15.57:0/4265435012 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:46:45.281 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:45.278+0000 7fa464f07700 1 -- 172.21.15.57:0/4265435012 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa44c0094b0 con 0x7fa4601238c0 2023-03-03T07:46:45.281 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:45.278+0000 7fa464f07700 1 --2- 172.21.15.57:0/4265435012 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4601238c0 0x7fa46011ca40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa45400c680 tx=0x7fa45400ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:45.282 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:45.278+0000 7fa45d7fa700 1 -- 172.21.15.57:0/4265435012 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa454005cc0 con 0x7fa4601238c0 2023-03-03T07:46:45.282 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:45.278+0000 7fa45d7fa700 1 -- 172.21.15.57:0/4265435012 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa454005e20 con 0x7fa4601238c0 2023-03-03T07:46:45.282 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:45.278+0000 7fa465f09700 1 -- 172.21.15.57:0/4265435012 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa460123490 con 0x7fa4601238c0 2023-03-03T07:46:45.283 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:45.278+0000 7fa45d7fa700 1 -- 172.21.15.57:0/4265435012 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa454007220 con 0x7fa4601238c0 2023-03-03T07:46:45.283 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:45.278+0000 7fa465f09700 1 -- 172.21.15.57:0/4265435012 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa460123300 con 0x7fa4601238c0 2023-03-03T07:46:45.284 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:45.282+0000 7fa465f09700 1 -- 172.21.15.57:0/4265435012 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa46012a600 con 0x7fa4601238c0 2023-03-03T07:46:45.285 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:45.282+0000 7fa45d7fa700 1 -- 172.21.15.57:0/4265435012 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 9) v1 ==== 42325+0+0 (secure 0 0 0) 0x7fa454019030 con 0x7fa4601238c0 2023-03-03T07:46:45.286 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:45.282+0000 7fa45d7fa700 1 --2- 172.21.15.57:0/4265435012 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fa444034910 0x7fa444036dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:45.286 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:45.282+0000 7fa45d7fa700 1 -- 172.21.15.57:0/4265435012 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 2928+0+0 (secure 0 0 0) 0x7fa454045730 con 0x7fa4601238c0 2023-03-03T07:46:45.287 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:45.286+0000 7fa45ffff700 1 --2- 172.21.15.57:0/4265435012 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fa444034910 0x7fa444036dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:45.289 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:45.286+0000 7fa45ffff700 1 --2- 172.21.15.57:0/4265435012 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fa444034910 0x7fa444036dc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa44c006ee0 tx=0x7fa44c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:45.294 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:45.290+0000 7fa45d7fa700 1 -- 172.21.15.57:0/4265435012 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa4540196b0 con 0x7fa4601238c0 2023-03-03T07:46:45.505 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:45.502+0000 7fa465f09700 1 -- 172.21.15.57:0/4265435012 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sub_0", "snap_name": "snap_0", "target_sub_name": "clone_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fa46011c5d0 con 0x7fa444034910 2023-03-03T07:46:45.597 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:45.594+0000 7fa45d7fa700 1 -- 172.21.15.57:0/4265435012 <== mgr.4099 v2:172.21.15.57:6808/28565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fa46011c5d0 con 0x7fa444034910 2023-03-03T07:46:45.732 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:45.730+0000 7fa465f09700 1 -- 172.21.15.57:0/4265435012 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 1: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sub_0", "snap_name": "snap_0", "target_sub_name": "clone_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fa4600619b0 con 0x7fa444034910 2023-03-03T07:46:50.054 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:46:50.050+0000 7fde62304700 -1 mgr.server reply reply (17) File exists subvolume 'clone_4' exists 2023-03-03T07:46:50.055 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.050+0000 7fa45d7fa700 1 -- 172.21.15.57:0/4265435012 <== mgr.4099 v2:172.21.15.57:6808/28565 2 ==== mgr_command_reply(tid 1: -17 subvolume 'clone_4' exists) v1 ==== 34+0+0 (secure 0 0 0) 0x7fa4600619b0 con 0x7fa444034910 2023-03-03T07:46:50.058 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.054+0000 7fa465f09700 1 -- 172.21.15.57:0/4265435012 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fa444034910 msgr2=0x7fa444036dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:50.058 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.054+0000 7fa465f09700 1 --2- 172.21.15.57:0/4265435012 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fa444034910 0x7fa444036dc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa44c006ee0 tx=0x7fa44c008030 comp rx=0 tx=0).stop 2023-03-03T07:46:50.059 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.054+0000 7fa465f09700 1 -- 172.21.15.57:0/4265435012 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4601238c0 msgr2=0x7fa46011ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:50.059 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.054+0000 7fa465f09700 1 --2- 172.21.15.57:0/4265435012 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4601238c0 0x7fa46011ca40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa45400c680 tx=0x7fa45400ca40 comp rx=0 tx=0).stop 2023-03-03T07:46:50.059 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.058+0000 7fa465f09700 1 -- 172.21.15.57:0/4265435012 shutdown_connections 2023-03-03T07:46:50.059 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.058+0000 7fa465f09700 1 --2- 172.21.15.57:0/4265435012 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fa444034910 0x7fa444036dc0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:50.060 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.058+0000 7fa465f09700 1 --2- 172.21.15.57:0/4265435012 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4601238c0 0x7fa46011ca40 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:50.060 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.058+0000 7fa465f09700 1 -- 172.21.15.57:0/4265435012 >> 172.21.15.57:0/4265435012 conn(0x7fa4600948c0 msgr2=0x7fa46006c910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:46:50.060 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.058+0000 7fa465f09700 1 -- 172.21.15.57:0/4265435012 shutdown_connections 2023-03-03T07:46:50.060 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.058+0000 7fa465f09700 1 -- 172.21.15.57:0/4265435012 wait complete. 2023-03-03T07:46:50.062 INFO:tasks.workunit.client.0.smithi057.stderr:Second attempt of previously successful command failed with EEXIST: subvolume 'clone_4' exists 2023-03-03T07:46:50.062 INFO:tasks.workunit.client.0.smithi057.stderr:subvolume 'clone_4' exists 2023-03-03T07:46:50.084 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in $(eval echo {1..$NUM_CLONES}) 2023-03-03T07:46:50.085 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph fs subvolume snapshot clone cephfs sub_0 snap_0 clone_5 2023-03-03T07:46:50.257 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.254+0000 7f1f0759e700 1 Processor -- start 2023-03-03T07:46:50.257 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.254+0000 7f1f0759e700 1 -- start start 2023-03-03T07:46:50.258 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.254+0000 7f1f0759e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1f08123a60 0x7f1f08123480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:50.258 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.254+0000 7f1f0759e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f0808d930 con 0x7f1f08095eb0 2023-03-03T07:46:50.259 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.254+0000 7f1f0759e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f0812a920 con 0x7f1f08123a60 2023-03-03T07:46:50.259 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.258+0000 7f1f0659c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1f08123a60 0x7f1f08123480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:50.259 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.258+0000 7f1f0659c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1f08123a60 0x7f1f08123480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58900/0 (socket says 172.21.15.57:58900) 2023-03-03T07:46:50.260 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.258+0000 7f1f0659c700 1 -- 172.21.15.57:0/3321606451 learned_addr learned my addr 172.21.15.57:0/3321606451 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:46:50.260 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.258+0000 7f1f05d9b700 1 --1- 172.21.15.57:0/3321606451 >> v1:172.21.15.57:6789/0 conn(0x7f1f08095eb0 0x7f1f08123e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:43332/0 (socket says 172.21.15.57:43332) 2023-03-03T07:46:50.260 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.258+0000 7f1f0659c700 1 -- 172.21.15.57:0/3321606451 >> v1:172.21.15.57:6789/0 conn(0x7f1f08095eb0 legacy=0x7f1f08123e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:50.261 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.258+0000 7f1f0659c700 1 -- 172.21.15.57:0/3321606451 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f0812aa60 con 0x7f1f08123a60 2023-03-03T07:46:50.261 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.258+0000 7f1f0659c700 1 --2- 172.21.15.57:0/3321606451 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f08123a60 0x7f1f08123480 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1ef8009890 tx=0x7f1ef8009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e1c395c6583ad3f server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:50.262 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.258+0000 7f1f0559a700 1 -- 172.21.15.57:0/3321606451 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ef8004160 con 0x7f1f08123a60 2023-03-03T07:46:50.262 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.258+0000 7f1f0559a700 1 -- 172.21.15.57:0/3321606451 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ef80042c0 con 0x7f1f08123a60 2023-03-03T07:46:50.262 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.258+0000 7f1f0559a700 1 -- 172.21.15.57:0/3321606451 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ef8004580 con 0x7f1f08123a60 2023-03-03T07:46:50.263 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.258+0000 7f1f0759e700 1 -- 172.21.15.57:0/3321606451 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f08123a60 msgr2=0x7f1f08123480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:50.263 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.258+0000 7f1f0759e700 1 --2- 172.21.15.57:0/3321606451 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f08123a60 0x7f1f08123480 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1ef8009890 tx=0x7f1ef8009ba0 comp rx=0 tx=0).stop 2023-03-03T07:46:50.264 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.262+0000 7f1f0759e700 1 -- 172.21.15.57:0/3321606451 shutdown_connections 2023-03-03T07:46:50.264 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.262+0000 7f1f0759e700 1 --2- 172.21.15.57:0/3321606451 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f08123a60 0x7f1f08123480 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:50.265 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.262+0000 7f1f0759e700 1 -- 172.21.15.57:0/3321606451 >> 172.21.15.57:0/3321606451 conn(0x7f1f08094b00 msgr2=0x7f1f08094ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:46:50.265 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.262+0000 7f1f0759e700 1 -- 172.21.15.57:0/3321606451 shutdown_connections 2023-03-03T07:46:50.265 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.262+0000 7f1f0759e700 1 -- 172.21.15.57:0/3321606451 wait complete. 2023-03-03T07:46:50.267 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.262+0000 7f1f0759e700 1 Processor -- start 2023-03-03T07:46:50.267 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.266+0000 7f1f0759e700 1 -- start start 2023-03-03T07:46:50.268 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.266+0000 7f1f0759e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f08095eb0 0x7f1f081bbea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:50.268 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.266+0000 7f1f0759e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0806b470 con 0x7f1f08095eb0 2023-03-03T07:46:50.269 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.266+0000 7f1f0659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f08095eb0 0x7f1f081bbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:50.269 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.266+0000 7f1f0659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f08095eb0 0x7f1f081bbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58906/0 (socket says 172.21.15.57:58906) 2023-03-03T07:46:50.269 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.266+0000 7f1f0659c700 1 -- 172.21.15.57:0/1268163310 learned_addr learned my addr 172.21.15.57:0/1268163310 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:46:50.270 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.266+0000 7f1f0659c700 1 -- 172.21.15.57:0/1268163310 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef8009570 con 0x7f1f08095eb0 2023-03-03T07:46:50.270 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.266+0000 7f1f0659c700 1 --2- 172.21.15.57:0/1268163310 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f08095eb0 0x7f1f081bbea0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1ef8009be0 tx=0x7f1ef8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:50.271 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.266+0000 7f1ef6ffd700 1 -- 172.21.15.57:0/1268163310 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ef800b670 con 0x7f1f08095eb0 2023-03-03T07:46:50.271 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.266+0000 7f1ef6ffd700 1 -- 172.21.15.57:0/1268163310 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ef800b7d0 con 0x7f1f08095eb0 2023-03-03T07:46:50.271 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.266+0000 7f1f0759e700 1 -- 172.21.15.57:0/1268163310 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f08129cf0 con 0x7f1f08095eb0 2023-03-03T07:46:50.271 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.266+0000 7f1ef6ffd700 1 -- 172.21.15.57:0/1268163310 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ef800ba70 con 0x7f1f08095eb0 2023-03-03T07:46:50.272 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.270+0000 7f1f0759e700 1 -- 172.21.15.57:0/1268163310 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f08129b60 con 0x7f1f08095eb0 2023-03-03T07:46:50.273 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.270+0000 7f1f0759e700 1 -- 172.21.15.57:0/1268163310 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f08129e80 con 0x7f1f08095eb0 2023-03-03T07:46:50.273 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.270+0000 7f1ef6ffd700 1 -- 172.21.15.57:0/1268163310 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 9) v1 ==== 42325+0+0 (secure 0 0 0) 0x7f1ef8017020 con 0x7f1f08095eb0 2023-03-03T07:46:50.275 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.270+0000 7f1ef6ffd700 1 --2- 172.21.15.57:0/1268163310 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f1ee8034900 0x7f1ee8036db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:50.275 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.270+0000 7f1ef6ffd700 1 -- 172.21.15.57:0/1268163310 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 2928+0+0 (secure 0 0 0) 0x7f1ef8047f90 con 0x7f1f08095eb0 2023-03-03T07:46:50.275 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.274+0000 7f1f05d9b700 1 --2- 172.21.15.57:0/1268163310 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f1ee8034900 0x7f1ee8036db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:50.276 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.274+0000 7f1f05d9b700 1 --2- 172.21.15.57:0/1268163310 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f1ee8034900 0x7f1ee8036db0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1efc000f60 tx=0x7f1efc007b50 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:50.282 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.278+0000 7f1ef6ffd700 1 -- 172.21.15.57:0/1268163310 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1ef8006c80 con 0x7f1f08095eb0 2023-03-03T07:46:50.491 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.486+0000 7f1f0759e700 1 -- 172.21.15.57:0/1268163310 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sub_0", "snap_name": "snap_0", "target_sub_name": "clone_5", "target": ["mon-mgr", ""]}) v1 -- 0x7f1f080619b0 con 0x7f1ee8034900 2023-03-03T07:46:50.581 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.578+0000 7f1ef6ffd700 1 -- 172.21.15.57:0/1268163310 <== mgr.4099 v2:172.21.15.57:6808/28565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f1f080619b0 con 0x7f1ee8034900 2023-03-03T07:46:50.717 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.714+0000 7f1f0759e700 1 -- 172.21.15.57:0/1268163310 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 1: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sub_0", "snap_name": "snap_0", "target_sub_name": "clone_5", "target": ["mon-mgr", ""]}) v1 -- 0x7f1f08069f70 con 0x7f1ee8034900 2023-03-03T07:46:50.746 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:46:50.742+0000 7fde62304700 -1 mgr.server reply reply (17) File exists subvolume 'clone_5' exists 2023-03-03T07:46:50.747 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.742+0000 7f1ef6ffd700 1 -- 172.21.15.57:0/1268163310 <== mgr.4099 v2:172.21.15.57:6808/28565 2 ==== mgr_command_reply(tid 1: -17 subvolume 'clone_5' exists) v1 ==== 34+0+0 (secure 0 0 0) 0x7f1f08069f70 con 0x7f1ee8034900 2023-03-03T07:46:50.749 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.746+0000 7f1f0759e700 1 -- 172.21.15.57:0/1268163310 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f1ee8034900 msgr2=0x7f1ee8036db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:50.749 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.746+0000 7f1f0759e700 1 --2- 172.21.15.57:0/1268163310 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f1ee8034900 0x7f1ee8036db0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1efc000f60 tx=0x7f1efc007b50 comp rx=0 tx=0).stop 2023-03-03T07:46:50.750 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.746+0000 7f1f0759e700 1 -- 172.21.15.57:0/1268163310 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f08095eb0 msgr2=0x7f1f081bbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:50.750 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.746+0000 7f1f0759e700 1 --2- 172.21.15.57:0/1268163310 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f08095eb0 0x7f1f081bbea0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1ef8009be0 tx=0x7f1ef8004770 comp rx=0 tx=0).stop 2023-03-03T07:46:50.750 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.746+0000 7f1f0759e700 1 -- 172.21.15.57:0/1268163310 shutdown_connections 2023-03-03T07:46:50.750 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.746+0000 7f1f0759e700 1 --2- 172.21.15.57:0/1268163310 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f1ee8034900 0x7f1ee8036db0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:50.750 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.746+0000 7f1f0759e700 1 --2- 172.21.15.57:0/1268163310 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f08095eb0 0x7f1f081bbea0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:50.750 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.746+0000 7f1f0759e700 1 -- 172.21.15.57:0/1268163310 >> 172.21.15.57:0/1268163310 conn(0x7f1f08094b00 msgr2=0x7f1f081289e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:46:50.750 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.746+0000 7f1f0759e700 1 -- 172.21.15.57:0/1268163310 shutdown_connections 2023-03-03T07:46:50.751 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.746+0000 7f1f0759e700 1 -- 172.21.15.57:0/1268163310 wait complete. 2023-03-03T07:46:50.752 INFO:tasks.workunit.client.0.smithi057.stderr:Second attempt of previously successful command failed with EEXIST: subvolume 'clone_5' exists 2023-03-03T07:46:50.753 INFO:tasks.workunit.client.0.smithi057.stderr:subvolume 'clone_5' exists 2023-03-03T07:46:50.776 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in $(eval echo {1..$NUM_CLONES}) 2023-03-03T07:46:50.776 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph fs subvolume snapshot clone cephfs sub_0 snap_0 clone_6 2023-03-03T07:46:50.942 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.938+0000 7f4e4359e700 1 Processor -- start 2023-03-03T07:46:50.942 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.938+0000 7f4e4359e700 1 -- start start 2023-03-03T07:46:50.944 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.942+0000 7f4e4359e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4e44123670 0x7f4e44123a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:50.944 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.942+0000 7f4e4359e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e4408c040 con 0x7f4e4408eb60 2023-03-03T07:46:50.945 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.942+0000 7f4e4359e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e44123190 con 0x7f4e44123670 2023-03-03T07:46:50.945 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.942+0000 7f4e4259c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4e44123670 0x7f4e44123a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:50.945 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.942+0000 7f4e41d9b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f4e4408eb60 0x7f4e4408ef90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:43338/0 (socket says 172.21.15.57:43338) 2023-03-03T07:46:50.946 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.942+0000 7f4e41d9b700 1 -- 172.21.15.57:0/2019098377 learned_addr learned my addr 172.21.15.57:0/2019098377 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:46:50.946 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.942+0000 7f4e4159a700 1 -- 172.21.15.57:0/2019098377 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2326744695 0 0) 0x7f4e4408c040 con 0x7f4e4408eb60 2023-03-03T07:46:50.946 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.942+0000 7f4e4159a700 1 -- 172.21.15.57:0/2019098377 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e2c0035d0 con 0x7f4e4408eb60 2023-03-03T07:46:50.946 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.942+0000 7f4e4259c700 1 -- 172.21.15.57:0/2019098377 >> v1:172.21.15.57:6789/0 conn(0x7f4e4408eb60 legacy=0x7f4e4408ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:50.947 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.942+0000 7f4e4259c700 1 -- 172.21.15.57:0/2019098377 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e44123f80 con 0x7f4e44123670 2023-03-03T07:46:50.947 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.942+0000 7f4e4259c700 1 --2- 172.21.15.57:0/2019098377 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e44123670 0x7f4e44123a40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4e340097d0 tx=0x7f4e34009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d6e6cb6038efba3 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:50.947 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.946+0000 7f4e4159a700 1 -- 172.21.15.57:0/2019098377 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4e34004160 con 0x7f4e44123670 2023-03-03T07:46:50.947 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.946+0000 7f4e4159a700 1 -- 172.21.15.57:0/2019098377 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e340042c0 con 0x7f4e44123670 2023-03-03T07:46:50.948 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.946+0000 7f4e4159a700 1 -- 172.21.15.57:0/2019098377 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4e340045a0 con 0x7f4e44123670 2023-03-03T07:46:50.948 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.946+0000 7f4e4359e700 1 -- 172.21.15.57:0/2019098377 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e44123670 msgr2=0x7f4e44123a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:50.948 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.946+0000 7f4e4359e700 1 --2- 172.21.15.57:0/2019098377 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e44123670 0x7f4e44123a40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4e340097d0 tx=0x7f4e34009ae0 comp rx=0 tx=0).stop 2023-03-03T07:46:50.950 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.946+0000 7f4e4359e700 1 -- 172.21.15.57:0/2019098377 shutdown_connections 2023-03-03T07:46:50.950 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.946+0000 7f4e4359e700 1 --2- 172.21.15.57:0/2019098377 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e44123670 0x7f4e44123a40 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:50.950 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.946+0000 7f4e4359e700 1 -- 172.21.15.57:0/2019098377 >> 172.21.15.57:0/2019098377 conn(0x7f4e44094b00 msgr2=0x7f4e44094ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:46:50.950 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.946+0000 7f4e4359e700 1 -- 172.21.15.57:0/2019098377 shutdown_connections 2023-03-03T07:46:50.950 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.946+0000 7f4e4359e700 1 -- 172.21.15.57:0/2019098377 wait complete. 2023-03-03T07:46:50.952 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.950+0000 7f4e4359e700 1 Processor -- start 2023-03-03T07:46:50.953 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.950+0000 7f4e4359e700 1 -- start start 2023-03-03T07:46:50.954 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.950+0000 7f4e4359e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e4408eb60 0x7f4e44122420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:50.954 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.950+0000 7f4e4359e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e44128690 con 0x7f4e4408eb60 2023-03-03T07:46:50.954 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.950+0000 7f4e4259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e4408eb60 0x7f4e44122420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:50.955 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.950+0000 7f4e4259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e4408eb60 0x7f4e44122420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58932/0 (socket says 172.21.15.57:58932) 2023-03-03T07:46:50.955 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.950+0000 7f4e4259c700 1 -- 172.21.15.57:0/3070338341 learned_addr learned my addr 172.21.15.57:0/3070338341 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:46:50.955 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.954+0000 7f4e4259c700 1 -- 172.21.15.57:0/3070338341 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e340094b0 con 0x7f4e4408eb60 2023-03-03T07:46:50.956 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.954+0000 7f4e4259c700 1 --2- 172.21.15.57:0/3070338341 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e4408eb60 0x7f4e44122420 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4e340090b0 tx=0x7f4e34004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:50.956 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.954+0000 7f4e32ffd700 1 -- 172.21.15.57:0/3070338341 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4e34003c80 con 0x7f4e4408eb60 2023-03-03T07:46:50.956 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.954+0000 7f4e32ffd700 1 -- 172.21.15.57:0/3070338341 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e3401f070 con 0x7f4e4408eb60 2023-03-03T07:46:50.957 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.954+0000 7f4e4359e700 1 -- 172.21.15.57:0/3070338341 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e4408f830 con 0x7f4e4408eb60 2023-03-03T07:46:50.957 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.954+0000 7f4e32ffd700 1 -- 172.21.15.57:0/3070338341 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4e34011630 con 0x7f4e4408eb60 2023-03-03T07:46:50.957 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.954+0000 7f4e4359e700 1 -- 172.21.15.57:0/3070338341 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e4408f6a0 con 0x7f4e4408eb60 2023-03-03T07:46:50.958 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.954+0000 7f4e4359e700 1 -- 172.21.15.57:0/3070338341 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e4408f9c0 con 0x7f4e4408eb60 2023-03-03T07:46:50.959 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.954+0000 7f4e32ffd700 1 -- 172.21.15.57:0/3070338341 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 9) v1 ==== 42325+0+0 (secure 0 0 0) 0x7f4e3402a020 con 0x7f4e4408eb60 2023-03-03T07:46:50.959 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.958+0000 7f4e32ffd700 1 --2- 172.21.15.57:0/3070338341 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f4e240348b0 0x7f4e24036d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:50.960 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.958+0000 7f4e32ffd700 1 -- 172.21.15.57:0/3070338341 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 2928+0+0 (secure 0 0 0) 0x7f4e34047a20 con 0x7f4e4408eb60 2023-03-03T07:46:50.960 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.958+0000 7f4e41d9b700 1 --2- 172.21.15.57:0/3070338341 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f4e240348b0 0x7f4e24036d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:50.961 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.958+0000 7f4e41d9b700 1 --2- 172.21.15.57:0/3070338341 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f4e240348b0 0x7f4e24036d60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4e380016d0 tx=0x7f4e38007a20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:50.966 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:50.962+0000 7f4e32ffd700 1 -- 172.21.15.57:0/3070338341 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4e34011830 con 0x7f4e4408eb60 2023-03-03T07:46:51.179 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.174+0000 7f4e4359e700 1 -- 172.21.15.57:0/3070338341 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sub_0", "snap_name": "snap_0", "target_sub_name": "clone_6", "target": ["mon-mgr", ""]}) v1 -- 0x7f4e441287d0 con 0x7f4e240348b0 2023-03-03T07:46:51.267 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.266+0000 7f4e32ffd700 1 -- 172.21.15.57:0/3070338341 <== mgr.4099 v2:172.21.15.57:6808/28565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f4e441287d0 con 0x7f4e240348b0 2023-03-03T07:46:51.427 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.422+0000 7f4e4359e700 1 -- 172.21.15.57:0/3070338341 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 1: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sub_0", "snap_name": "snap_0", "target_sub_name": "clone_6", "target": ["mon-mgr", ""]}) v1 -- 0x7f4e440008d0 con 0x7f4e240348b0 2023-03-03T07:46:51.452 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:46:51.450+0000 7fde62304700 -1 mgr.server reply reply (17) File exists subvolume 'clone_6' exists 2023-03-03T07:46:51.452 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.450+0000 7f4e32ffd700 1 -- 172.21.15.57:0/3070338341 <== mgr.4099 v2:172.21.15.57:6808/28565 2 ==== mgr_command_reply(tid 1: -17 subvolume 'clone_6' exists) v1 ==== 34+0+0 (secure 0 0 0) 0x7f4e440008d0 con 0x7f4e240348b0 2023-03-03T07:46:51.457 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.454+0000 7f4e4359e700 1 -- 172.21.15.57:0/3070338341 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f4e240348b0 msgr2=0x7f4e24036d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:51.458 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.454+0000 7f4e4359e700 1 --2- 172.21.15.57:0/3070338341 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f4e240348b0 0x7f4e24036d60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4e380016d0 tx=0x7f4e38007a20 comp rx=0 tx=0).stop 2023-03-03T07:46:51.458 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.454+0000 7f4e4359e700 1 -- 172.21.15.57:0/3070338341 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e4408eb60 msgr2=0x7f4e44122420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:51.458 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.454+0000 7f4e4359e700 1 --2- 172.21.15.57:0/3070338341 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e4408eb60 0x7f4e44122420 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4e340090b0 tx=0x7f4e34004770 comp rx=0 tx=0).stop 2023-03-03T07:46:51.458 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.454+0000 7f4e4359e700 1 -- 172.21.15.57:0/3070338341 shutdown_connections 2023-03-03T07:46:51.459 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.454+0000 7f4e4359e700 1 --2- 172.21.15.57:0/3070338341 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f4e240348b0 0x7f4e24036d60 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:51.459 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.454+0000 7f4e4359e700 1 --2- 172.21.15.57:0/3070338341 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e4408eb60 0x7f4e44122420 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:51.459 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.454+0000 7f4e4359e700 1 -- 172.21.15.57:0/3070338341 >> 172.21.15.57:0/3070338341 conn(0x7f4e44094b00 msgr2=0x7f4e44070f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:46:51.459 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.454+0000 7f4e4359e700 1 -- 172.21.15.57:0/3070338341 shutdown_connections 2023-03-03T07:46:51.459 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.454+0000 7f4e4359e700 1 -- 172.21.15.57:0/3070338341 wait complete. 2023-03-03T07:46:51.461 INFO:tasks.workunit.client.0.smithi057.stderr:Second attempt of previously successful command failed with EEXIST: subvolume 'clone_6' exists 2023-03-03T07:46:51.465 INFO:tasks.workunit.client.0.smithi057.stderr:subvolume 'clone_6' exists 2023-03-03T07:46:51.493 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in $(eval echo {1..$NUM_CLONES}) 2023-03-03T07:46:51.493 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph fs subvolume snapshot clone cephfs sub_0 snap_0 clone_7 2023-03-03T07:46:51.659 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.658+0000 7ff4c17ba700 1 Processor -- start 2023-03-03T07:46:51.660 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.658+0000 7ff4c17ba700 1 -- start start 2023-03-03T07:46:51.661 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.658+0000 7ff4c17ba700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff4bc128a40 0x7ff4bc12ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:51.662 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.658+0000 7ff4c17ba700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4bc071570 con 0x7ff4bc06c880 2023-03-03T07:46:51.662 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.658+0000 7ff4baffd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ff4bc06c880 0x7ff4bc06cc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:43344/0 (socket says 172.21.15.57:43344) 2023-03-03T07:46:51.662 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.658+0000 7ff4baffd700 1 -- 172.21.15.57:0/1013777916 learned_addr learned my addr 172.21.15.57:0/1013777916 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:46:51.662 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.658+0000 7ff4c17ba700 1 -- 172.21.15.57:0/1013777916 --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4bc0717b0 con 0x7ff4bc128a40 2023-03-03T07:46:51.663 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.658+0000 7ff4ba7fc700 1 -- 172.21.15.57:0/1013777916 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2053645146 0 0) 0x7ff4bc071570 con 0x7ff4bc06c880 2023-03-03T07:46:51.663 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.658+0000 7ff4ba7fc700 1 -- 172.21.15.57:0/1013777916 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4a80035d0 con 0x7ff4bc06c880 2023-03-03T07:46:51.664 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.658+0000 7ff4b3fff700 1 --2- 172.21.15.57:0/1013777916 >> v2:172.21.15.57:3300/0 conn(0x7ff4bc128a40 0x7ff4bc12ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:51.664 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.658+0000 7ff4ba7fc700 1 -- 172.21.15.57:0/1013777916 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 336550601 0 0) 0x7ff4a80035d0 con 0x7ff4bc06c880 2023-03-03T07:46:51.664 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.658+0000 7ff4ba7fc700 1 -- 172.21.15.57:0/1013777916 >> v2:172.21.15.57:3300/0 conn(0x7ff4bc128a40 msgr2=0x7ff4bc12ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T07:46:51.664 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.658+0000 7ff4ba7fc700 1 --2- 172.21.15.57:0/1013777916 >> v2:172.21.15.57:3300/0 conn(0x7ff4bc128a40 0x7ff4bc12ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:51.664 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.658+0000 7ff4ba7fc700 1 -- 172.21.15.57:0/1013777916 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4bc0970b0 con 0x7ff4bc06c880 2023-03-03T07:46:51.664 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.658+0000 7ff4ba7fc700 1 -- 172.21.15.57:0/1013777916 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (unknown 2779775165 0 0) 0x7ff4ac0015a0 con 0x7ff4bc06c880 2023-03-03T07:46:51.664 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.658+0000 7ff4ba7fc700 1 -- 172.21.15.57:0/1013777916 >> v1:172.21.15.57:6789/0 conn(0x7ff4bc06c880 legacy=0x7ff4bc06cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:51.665 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.658+0000 7ff4ba7fc700 1 --2- 172.21.15.57:0/1013777916 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4a8003a20 0x7ff4a8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:51.665 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.658+0000 7ff4ba7fc700 1 -- 172.21.15.57:0/1013777916 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc0717b0 con 0x7ff4a8003a20 2023-03-03T07:46:51.665 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.662+0000 7ff4b3fff700 1 --2- 172.21.15.57:0/1013777916 >> v2:172.21.15.57:3300/0 conn(0x7ff4bc128a40 0x7ff4bc12ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T07:46:51.665 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.662+0000 7ff4baffd700 1 --2- 172.21.15.57:0/1013777916 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4a8003a20 0x7ff4a8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:51.666 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.662+0000 7ff4baffd700 1 -- 172.21.15.57:0/1013777916 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a80035d0 con 0x7ff4a8003a20 2023-03-03T07:46:51.666 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.662+0000 7ff4baffd700 1 --2- 172.21.15.57:0/1013777916 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4a8003a20 0x7ff4a8003e10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac00c1c0 tx=0x7ff4a80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b39b66da70905015 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:51.666 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.662+0000 7ff4ba7fc700 1 -- 172.21.15.57:0/1013777916 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4ac00ca80 con 0x7ff4a8003a20 2023-03-03T07:46:51.666 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.662+0000 7ff4ba7fc700 1 -- 172.21.15.57:0/1013777916 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ac00cbe0 con 0x7ff4a8003a20 2023-03-03T07:46:51.667 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.662+0000 7ff4ba7fc700 1 -- 172.21.15.57:0/1013777916 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4ac005980 con 0x7ff4a8003a20 2023-03-03T07:46:51.667 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.662+0000 7ff4c17ba700 1 -- 172.21.15.57:0/1013777916 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4a8003a20 msgr2=0x7ff4a8003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:51.667 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.662+0000 7ff4c17ba700 1 --2- 172.21.15.57:0/1013777916 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4a8003a20 0x7ff4a8003e10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac00c1c0 tx=0x7ff4a80058a0 comp rx=0 tx=0).stop 2023-03-03T07:46:51.667 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.662+0000 7ff4c17ba700 1 -- 172.21.15.57:0/1013777916 shutdown_connections 2023-03-03T07:46:51.667 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.662+0000 7ff4c17ba700 1 --2- 172.21.15.57:0/1013777916 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4a8003a20 0x7ff4a8003e10 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:51.667 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.662+0000 7ff4c17ba700 1 --2- 172.21.15.57:0/1013777916 >> v2:172.21.15.57:3300/0 conn(0x7ff4bc128a40 0x7ff4bc12ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:51.667 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.662+0000 7ff4c17ba700 1 -- 172.21.15.57:0/1013777916 >> 172.21.15.57:0/1013777916 conn(0x7ff4bc069da0 msgr2=0x7ff4bc06a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:46:51.667 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.662+0000 7ff4c17ba700 1 -- 172.21.15.57:0/1013777916 shutdown_connections 2023-03-03T07:46:51.668 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.662+0000 7ff4c17ba700 1 -- 172.21.15.57:0/1013777916 wait complete. 2023-03-03T07:46:51.668 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.666+0000 7ff4c17ba700 1 Processor -- start 2023-03-03T07:46:51.668 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.666+0000 7ff4c17ba700 1 -- start start 2023-03-03T07:46:51.669 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.666+0000 7ff4c17ba700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4a8003a20 0x7ff4bc06da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:51.669 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.666+0000 7ff4c17ba700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc08f390 con 0x7ff4a8003a20 2023-03-03T07:46:51.670 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.666+0000 7ff4baffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4a8003a20 0x7ff4bc06da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:51.670 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.666+0000 7ff4baffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4a8003a20 0x7ff4bc06da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58956/0 (socket says 172.21.15.57:58956) 2023-03-03T07:46:51.670 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.666+0000 7ff4baffd700 1 -- 172.21.15.57:0/734823138 learned_addr learned my addr 172.21.15.57:0/734823138 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:46:51.670 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.666+0000 7ff4baffd700 1 -- 172.21.15.57:0/734823138 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4bc12b360 con 0x7ff4a8003a20 2023-03-03T07:46:51.671 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.666+0000 7ff4baffd700 1 --2- 172.21.15.57:0/734823138 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4a8003a20 0x7ff4bc06da60 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac000c00 tx=0x7ff4ac001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:51.671 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.666+0000 7ff4b37fe700 1 -- 172.21.15.57:0/734823138 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4ac00ce80 con 0x7ff4a8003a20 2023-03-03T07:46:51.671 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.670+0000 7ff4c17ba700 1 -- 172.21.15.57:0/734823138 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4bc06d3a0 con 0x7ff4a8003a20 2023-03-03T07:46:51.672 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.670+0000 7ff4b37fe700 1 -- 172.21.15.57:0/734823138 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ac0070d0 con 0x7ff4a8003a20 2023-03-03T07:46:51.672 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.670+0000 7ff4b37fe700 1 -- 172.21.15.57:0/734823138 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4ac0073b0 con 0x7ff4a8003a20 2023-03-03T07:46:51.672 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.670+0000 7ff4c17ba700 1 -- 172.21.15.57:0/734823138 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4bc12b4f0 con 0x7ff4a8003a20 2023-03-03T07:46:51.673 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.670+0000 7ff4b37fe700 1 -- 172.21.15.57:0/734823138 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 9) v1 ==== 42325+0+0 (secure 0 0 0) 0x7ff4ac023030 con 0x7ff4a8003a20 2023-03-03T07:46:51.674 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.670+0000 7ff4c17ba700 1 -- 172.21.15.57:0/734823138 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4bc0619b0 con 0x7ff4a8003a20 2023-03-03T07:46:51.674 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.670+0000 7ff4b37fe700 1 --2- 172.21.15.57:0/734823138 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7ff49c034910 0x7ff49c036dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:51.674 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.670+0000 7ff4b37fe700 1 -- 172.21.15.57:0/734823138 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 2928+0+0 (secure 0 0 0) 0x7ff4ac047860 con 0x7ff4a8003a20 2023-03-03T07:46:51.675 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.670+0000 7ff4b3fff700 1 --2- 172.21.15.57:0/734823138 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7ff49c034910 0x7ff49c036dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:51.675 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.674+0000 7ff4b3fff700 1 --2- 172.21.15.57:0/734823138 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7ff49c034910 0x7ff49c036dc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4006fd0 tx=0x7ff4a4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:51.681 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.678+0000 7ff4b37fe700 1 -- 172.21.15.57:0/734823138 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff4ac01c3f0 con 0x7ff4a8003a20 2023-03-03T07:46:51.890 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.886+0000 7ff4c17ba700 1 -- 172.21.15.57:0/734823138 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sub_0", "snap_name": "snap_0", "target_sub_name": "clone_7", "target": ["mon-mgr", ""]}) v1 -- 0x7ff4bc08efe0 con 0x7ff49c034910 2023-03-03T07:46:51.969 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:51.966+0000 7ff4b37fe700 1 -- 172.21.15.57:0/734823138 <== mgr.4099 v2:172.21.15.57:6808/28565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7ff4bc08efe0 con 0x7ff49c034910 2023-03-03T07:46:52.107 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.102+0000 7ff4c17ba700 1 -- 172.21.15.57:0/734823138 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 1: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sub_0", "snap_name": "snap_0", "target_sub_name": "clone_7", "target": ["mon-mgr", ""]}) v1 -- 0x7ff4bc074130 con 0x7ff49c034910 2023-03-03T07:46:52.134 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:46:52.130+0000 7fde62304700 -1 mgr.server reply reply (17) File exists subvolume 'clone_7' exists 2023-03-03T07:46:52.135 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.130+0000 7ff4b37fe700 1 -- 172.21.15.57:0/734823138 <== mgr.4099 v2:172.21.15.57:6808/28565 2 ==== mgr_command_reply(tid 1: -17 subvolume 'clone_7' exists) v1 ==== 34+0+0 (secure 0 0 0) 0x7ff4bc074130 con 0x7ff49c034910 2023-03-03T07:46:52.138 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.134+0000 7ff4c17ba700 1 -- 172.21.15.57:0/734823138 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7ff49c034910 msgr2=0x7ff49c036dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:52.138 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.134+0000 7ff4c17ba700 1 --2- 172.21.15.57:0/734823138 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7ff49c034910 0x7ff49c036dc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4006fd0 tx=0x7ff4a4008040 comp rx=0 tx=0).stop 2023-03-03T07:46:52.138 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.134+0000 7ff4c17ba700 1 -- 172.21.15.57:0/734823138 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4a8003a20 msgr2=0x7ff4bc06da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:52.138 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.134+0000 7ff4c17ba700 1 --2- 172.21.15.57:0/734823138 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4a8003a20 0x7ff4bc06da60 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac000c00 tx=0x7ff4ac001930 comp rx=0 tx=0).stop 2023-03-03T07:46:52.139 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.134+0000 7ff4c17ba700 1 -- 172.21.15.57:0/734823138 shutdown_connections 2023-03-03T07:46:52.139 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.134+0000 7ff4c17ba700 1 --2- 172.21.15.57:0/734823138 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7ff49c034910 0x7ff49c036dc0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:52.139 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.134+0000 7ff4c17ba700 1 --2- 172.21.15.57:0/734823138 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4a8003a20 0x7ff4bc06da60 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:52.140 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.134+0000 7ff4c17ba700 1 -- 172.21.15.57:0/734823138 >> 172.21.15.57:0/734823138 conn(0x7ff4bc069da0 msgr2=0x7ff4bc125a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:46:52.140 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.134+0000 7ff4c17ba700 1 -- 172.21.15.57:0/734823138 shutdown_connections 2023-03-03T07:46:52.140 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.134+0000 7ff4c17ba700 1 -- 172.21.15.57:0/734823138 wait complete. 2023-03-03T07:46:52.141 INFO:tasks.workunit.client.0.smithi057.stderr:Second attempt of previously successful command failed with EEXIST: subvolume 'clone_7' exists 2023-03-03T07:46:52.142 INFO:tasks.workunit.client.0.smithi057.stderr:subvolume 'clone_7' exists 2023-03-03T07:46:52.167 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in $(eval echo {1..$NUM_CLONES}) 2023-03-03T07:46:52.168 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph fs subvolume snapshot clone cephfs sub_0 snap_0 clone_8 2023-03-03T07:46:52.345 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.342+0000 7f566b59e700 1 Processor -- start 2023-03-03T07:46:52.345 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.342+0000 7f566b59e700 1 -- start start 2023-03-03T07:46:52.346 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.342+0000 7f566b59e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f566c08b220 0x7f566c08b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:52.346 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.342+0000 7f566b59e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f566c08c3e0 con 0x7f566c08bb30 2023-03-03T07:46:52.347 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.342+0000 7f566b59e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f566c08d330 con 0x7f566c08b220 2023-03-03T07:46:52.347 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.342+0000 7f5663fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f566c08bb30 0x7f566c124800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:43352/0 (socket says 172.21.15.57:43352) 2023-03-03T07:46:52.347 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.342+0000 7f5663fff700 1 -- 172.21.15.57:0/145760724 learned_addr learned my addr 172.21.15.57:0/145760724 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:46:52.347 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.346+0000 7f566a59c700 1 --2- 172.21.15.57:0/145760724 >> v2:172.21.15.57:3300/0 conn(0x7f566c08b220 0x7f566c08b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:52.348 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.346+0000 7f5669d9b700 1 -- 172.21.15.57:0/145760724 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1842869871 0 0) 0x7f566c08c3e0 con 0x7f566c08bb30 2023-03-03T07:46:52.348 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.346+0000 7f5669d9b700 1 -- 172.21.15.57:0/145760724 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56580035d0 con 0x7f566c08bb30 2023-03-03T07:46:52.348 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.346+0000 7f566a59c700 1 -- 172.21.15.57:0/145760724 >> v1:172.21.15.57:6789/0 conn(0x7f566c08bb30 legacy=0x7f566c124800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:52.349 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.346+0000 7f566a59c700 1 -- 172.21.15.57:0/145760724 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f566c08d640 con 0x7f566c08b220 2023-03-03T07:46:52.349 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.346+0000 7f566a59c700 1 --2- 172.21.15.57:0/145760724 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f566c08b220 0x7f566c08b5f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f565c0097d0 tx=0x7f565c009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1edb3e069c1de454 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:52.349 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.346+0000 7f5669d9b700 1 -- 172.21.15.57:0/145760724 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f565c004160 con 0x7f566c08b220 2023-03-03T07:46:52.350 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.346+0000 7f5669d9b700 1 -- 172.21.15.57:0/145760724 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f565c0042c0 con 0x7f566c08b220 2023-03-03T07:46:52.350 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.346+0000 7f5669d9b700 1 -- 172.21.15.57:0/145760724 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f565c0045a0 con 0x7f566c08b220 2023-03-03T07:46:52.350 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.346+0000 7f566b59e700 1 -- 172.21.15.57:0/145760724 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f566c08b220 msgr2=0x7f566c08b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:52.350 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.346+0000 7f566b59e700 1 --2- 172.21.15.57:0/145760724 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f566c08b220 0x7f566c08b5f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f565c0097d0 tx=0x7f565c009ae0 comp rx=0 tx=0).stop 2023-03-03T07:46:52.351 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.346+0000 7f566b59e700 1 -- 172.21.15.57:0/145760724 shutdown_connections 2023-03-03T07:46:52.351 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.346+0000 7f566b59e700 1 --2- 172.21.15.57:0/145760724 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f566c08b220 0x7f566c08b5f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:52.351 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.346+0000 7f566b59e700 1 -- 172.21.15.57:0/145760724 >> 172.21.15.57:0/145760724 conn(0x7f566c06e2f0 msgr2=0x7f566c070700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:46:52.351 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.346+0000 7f566b59e700 1 -- 172.21.15.57:0/145760724 shutdown_connections 2023-03-03T07:46:52.352 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.346+0000 7f566b59e700 1 -- 172.21.15.57:0/145760724 wait complete. 2023-03-03T07:46:52.353 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.350+0000 7f566b59e700 1 Processor -- start 2023-03-03T07:46:52.354 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.350+0000 7f566b59e700 1 -- start start 2023-03-03T07:46:52.356 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.354+0000 7f566b59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f566c08b220 0x7f566c1b89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:52.356 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.354+0000 7f566b59e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f566c123220 con 0x7f566c08b220 2023-03-03T07:46:52.357 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.354+0000 7f566a59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f566c08b220 0x7f566c1b89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:52.357 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.354+0000 7f566a59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f566c08b220 0x7f566c1b89b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58976/0 (socket says 172.21.15.57:58976) 2023-03-03T07:46:52.357 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.354+0000 7f566a59c700 1 -- 172.21.15.57:0/4291815058 learned_addr learned my addr 172.21.15.57:0/4291815058 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:46:52.357 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.354+0000 7f566a59c700 1 -- 172.21.15.57:0/4291815058 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f565c0094b0 con 0x7f566c08b220 2023-03-03T07:46:52.357 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.354+0000 7f566a59c700 1 --2- 172.21.15.57:0/4291815058 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f566c08b220 0x7f566c1b89b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f565c0090b0 tx=0x7f565c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:52.358 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.354+0000 7f5662ffd700 1 -- 172.21.15.57:0/4291815058 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f565c003c80 con 0x7f566c08b220 2023-03-03T07:46:52.358 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.354+0000 7f566b59e700 1 -- 172.21.15.57:0/4291815058 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f566c1252f0 con 0x7f566c08b220 2023-03-03T07:46:52.358 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.354+0000 7f5662ffd700 1 -- 172.21.15.57:0/4291815058 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f565c01f070 con 0x7f566c08b220 2023-03-03T07:46:52.359 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.354+0000 7f5662ffd700 1 -- 172.21.15.57:0/4291815058 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f565c011630 con 0x7f566c08b220 2023-03-03T07:46:52.359 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.354+0000 7f566b59e700 1 -- 172.21.15.57:0/4291815058 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f566c125160 con 0x7f566c08b220 2023-03-03T07:46:52.360 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.358+0000 7f566b59e700 1 -- 172.21.15.57:0/4291815058 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f566c125480 con 0x7f566c08b220 2023-03-03T07:46:52.360 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.358+0000 7f5662ffd700 1 -- 172.21.15.57:0/4291815058 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 9) v1 ==== 42325+0+0 (secure 0 0 0) 0x7f565c02a020 con 0x7f566c08b220 2023-03-03T07:46:52.361 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.358+0000 7f5662ffd700 1 --2- 172.21.15.57:0/4291815058 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f564c034900 0x7f564c036db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:52.361 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.358+0000 7f5662ffd700 1 -- 172.21.15.57:0/4291815058 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 2928+0+0 (secure 0 0 0) 0x7f565c047a80 con 0x7f566c08b220 2023-03-03T07:46:52.362 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.358+0000 7f5663fff700 1 --2- 172.21.15.57:0/4291815058 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f564c034900 0x7f564c036db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:52.363 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.362+0000 7f5663fff700 1 --2- 172.21.15.57:0/4291815058 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f564c034900 0x7f564c036db0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f566c08bf90 tx=0x7f5654007a20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:52.370 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.366+0000 7f5662ffd700 1 -- 172.21.15.57:0/4291815058 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f565c0117e0 con 0x7f566c08b220 2023-03-03T07:46:52.582 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.578+0000 7f566b59e700 1 -- 172.21.15.57:0/4291815058 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sub_0", "snap_name": "snap_0", "target_sub_name": "clone_8", "target": ["mon-mgr", ""]}) v1 -- 0x7f566c123360 con 0x7f564c034900 2023-03-03T07:46:52.667 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.666+0000 7f5662ffd700 1 -- 172.21.15.57:0/4291815058 <== mgr.4099 v2:172.21.15.57:6808/28565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f566c123360 con 0x7f564c034900 2023-03-03T07:46:52.804 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.802+0000 7f566b59e700 1 -- 172.21.15.57:0/4291815058 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 1: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sub_0", "snap_name": "snap_0", "target_sub_name": "clone_8", "target": ["mon-mgr", ""]}) v1 -- 0x7f566c0008d0 con 0x7f564c034900 2023-03-03T07:46:52.834 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:46:52.830+0000 7fde62304700 -1 mgr.server reply reply (17) File exists subvolume 'clone_8' exists 2023-03-03T07:46:52.835 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.830+0000 7f5662ffd700 1 -- 172.21.15.57:0/4291815058 <== mgr.4099 v2:172.21.15.57:6808/28565 2 ==== mgr_command_reply(tid 1: -17 subvolume 'clone_8' exists) v1 ==== 34+0+0 (secure 0 0 0) 0x7f566c0008d0 con 0x7f564c034900 2023-03-03T07:46:52.838 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.834+0000 7f566b59e700 1 -- 172.21.15.57:0/4291815058 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f564c034900 msgr2=0x7f564c036db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:52.838 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.834+0000 7f566b59e700 1 --2- 172.21.15.57:0/4291815058 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f564c034900 0x7f564c036db0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f566c08bf90 tx=0x7f5654007a20 comp rx=0 tx=0).stop 2023-03-03T07:46:52.838 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.834+0000 7f566b59e700 1 -- 172.21.15.57:0/4291815058 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f566c08b220 msgr2=0x7f566c1b89b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:52.838 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.834+0000 7f566b59e700 1 --2- 172.21.15.57:0/4291815058 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f566c08b220 0x7f566c1b89b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f565c0090b0 tx=0x7f565c004770 comp rx=0 tx=0).stop 2023-03-03T07:46:52.839 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.834+0000 7f566b59e700 1 -- 172.21.15.57:0/4291815058 shutdown_connections 2023-03-03T07:46:52.839 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.834+0000 7f566b59e700 1 --2- 172.21.15.57:0/4291815058 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f564c034900 0x7f564c036db0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:52.839 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.834+0000 7f566b59e700 1 --2- 172.21.15.57:0/4291815058 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f566c08b220 0x7f566c1b89b0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:52.840 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.834+0000 7f566b59e700 1 -- 172.21.15.57:0/4291815058 >> 172.21.15.57:0/4291815058 conn(0x7f566c06e2f0 msgr2=0x7f566c08f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:46:52.840 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.834+0000 7f566b59e700 1 -- 172.21.15.57:0/4291815058 shutdown_connections 2023-03-03T07:46:52.840 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:52.834+0000 7f566b59e700 1 -- 172.21.15.57:0/4291815058 wait complete. 2023-03-03T07:46:52.843 INFO:tasks.workunit.client.0.smithi057.stderr:Second attempt of previously successful command failed with EEXIST: subvolume 'clone_8' exists 2023-03-03T07:46:52.843 INFO:tasks.workunit.client.0.smithi057.stderr:subvolume 'clone_8' exists 2023-03-03T07:46:52.865 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in $(eval echo {1..$NUM_CLONES}) 2023-03-03T07:46:52.865 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph fs subvolume snapshot clone cephfs sub_0 snap_0 clone_9 2023-03-03T07:46:53.032 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:53.030+0000 7fe30c928700 1 Processor -- start 2023-03-03T07:46:53.032 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:53.030+0000 7fe30c928700 1 -- start start 2023-03-03T07:46:53.033 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:53.030+0000 7fe30c928700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe308123480 0x7fe30808b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:53.033 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:53.030+0000 7fe30c928700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe30808d930 con 0x7fe308095eb0 2023-03-03T07:46:53.033 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:53.030+0000 7fe30c928700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3081242f0 con 0x7fe308123480 2023-03-03T07:46:53.033 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:53.030+0000 7fe3077fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fe308095eb0 0x7fe30808afb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:43358/0 (socket says 172.21.15.57:43358) 2023-03-03T07:46:53.033 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:53.030+0000 7fe3077fe700 1 -- 172.21.15.57:0/1325651214 learned_addr learned my addr 172.21.15.57:0/1325651214 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:46:53.034 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:53.030+0000 7fe306ffd700 1 --2- 172.21.15.57:0/1325651214 >> v2:172.21.15.57:3300/0 conn(0x7fe308123480 0x7fe30808b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:53.034 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:53.030+0000 7fe3067fc700 1 -- 172.21.15.57:0/1325651214 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4029034022 0 0) 0x7fe30808d930 con 0x7fe308095eb0 2023-03-03T07:46:53.035 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:53.030+0000 7fe3067fc700 1 -- 172.21.15.57:0/1325651214 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2f00057e0 con 0x7fe308095eb0 2023-03-03T07:46:53.035 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:53.030+0000 7fe306ffd700 1 -- 172.21.15.57:0/1325651214 >> v1:172.21.15.57:6789/0 conn(0x7fe308095eb0 legacy=0x7fe30808afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:53.035 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:53.030+0000 7fe306ffd700 1 -- 172.21.15.57:0/1325651214 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe30808bc00 con 0x7fe308123480 2023-03-03T07:46:53.036 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:53.030+0000 7fe306ffd700 1 --2- 172.21.15.57:0/1325651214 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe308123480 0x7fe30808b6c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc0097d0 tx=0x7fe2fc009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e79ed0d738ca22de server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:53.036 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:53.030+0000 7fe3067fc700 1 -- 172.21.15.57:0/1325651214 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe2fc004160 con 0x7fe308123480 2023-03-03T07:46:53.036 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:53.034+0000 7fe3067fc700 1 -- 172.21.15.57:0/1325651214 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2fc0042c0 con 0x7fe308123480 2023-03-03T07:46:53.036 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:53.034+0000 7fe3067fc700 1 -- 172.21.15.57:0/1325651214 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe2fc0045a0 con 0x7fe308123480 2023-03-03T07:46:53.036 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:53.034+0000 7fe30c928700 1 -- 172.21.15.57:0/1325651214 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe308123480 msgr2=0x7fe30808b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:53.036 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:53.034+0000 7fe30c928700 1 --2- 172.21.15.57:0/1325651214 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe308123480 0x7fe30808b6c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc0097d0 tx=0x7fe2fc009ae0 comp rx=0 tx=0).stop 2023-03-03T07:46:53.037 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:53.034+0000 7fe30c928700 1 -- 172.21.15.57:0/1325651214 shutdown_connections 2023-03-03T07:46:53.037 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:53.034+0000 7fe30c928700 1 --2- 172.21.15.57:0/1325651214 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe308123480 0x7fe30808b6c0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:53.038 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:53.034+0000 7fe30c928700 1 -- 172.21.15.57:0/1325651214 >> 172.21.15.57:0/1325651214 conn(0x7fe308094b00 msgr2=0x7fe308094ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:46:53.038 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:53.034+0000 7fe30c928700 1 -- 172.21.15.57:0/1325651214 shutdown_connections 2023-03-03T07:46:53.038 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:53.034+0000 7fe30c928700 1 -- 172.21.15.57:0/1325651214 wait complete. 2023-03-03T07:46:53.040 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:53.038+0000 7fe30c928700 1 Processor -- start 2023-03-03T07:46:53.041 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:53.038+0000 7fe30c928700 1 -- start start 2023-03-03T07:46:53.041 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:53.038+0000 7fe30c928700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe308095eb0 0x7fe3081bab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:53.042 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:53.038+0000 7fe30c928700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3080719c0 con 0x7fe308095eb0 2023-03-03T07:46:53.042 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:53.038+0000 7fe3077fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe308095eb0 0x7fe3081bab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:53.042 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:53.038+0000 7fe3077fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe308095eb0 0x7fe3081bab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58992/0 (socket says 172.21.15.57:58992) 2023-03-03T07:46:53.043 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:53.038+0000 7fe3077fe700 1 -- 172.21.15.57:0/1843109889 learned_addr learned my addr 172.21.15.57:0/1843109889 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:46:53.043 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:53.038+0000 7fe3077fe700 1 -- 172.21.15.57:0/1843109889 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2fc0094b0 con 0x7fe308095eb0 2023-03-03T07:46:53.043 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:53.042+0000 7fe3077fe700 1 --2- 172.21.15.57:0/1843109889 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe308095eb0 0x7fe3081bab00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe2f800c680 tx=0x7fe2f800ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:53.044 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:53.042+0000 7fe2effff700 1 -- 172.21.15.57:0/1843109889 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe2f8005cc0 con 0x7fe308095eb0 2023-03-03T07:46:53.044 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:53.042+0000 7fe2effff700 1 -- 172.21.15.57:0/1843109889 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2f8005e20 con 0x7fe308095eb0 2023-03-03T07:46:53.044 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:53.042+0000 7fe2effff700 1 -- 172.21.15.57:0/1843109889 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe2f8007220 con 0x7fe308095eb0 2023-03-03T07:46:53.044 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:53.042+0000 7fe30c928700 1 -- 172.21.15.57:0/1843109889 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe308123e40 con 0x7fe308095eb0 2023-03-03T07:46:53.045 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:53.042+0000 7fe30c928700 1 -- 172.21.15.57:0/1843109889 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe308123cb0 con 0x7fe308095eb0 2023-03-03T07:46:53.046 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:53.042+0000 7fe30c928700 1 -- 172.21.15.57:0/1843109889 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe308123fd0 con 0x7fe308095eb0 2023-03-03T07:46:53.047 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:53.042+0000 7fe2effff700 1 -- 172.21.15.57:0/1843109889 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 9) v1 ==== 42325+0+0 (secure 0 0 0) 0x7fe2f8019030 con 0x7fe308095eb0 2023-03-03T07:46:53.047 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:53.046+0000 7fe2effff700 1 --2- 172.21.15.57:0/1843109889 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fe2f4034910 0x7fe2f4036dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:53.048 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:53.046+0000 7fe2effff700 1 -- 172.21.15.57:0/1843109889 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 2928+0+0 (secure 0 0 0) 0x7fe2f80456b0 con 0x7fe308095eb0 2023-03-03T07:46:53.048 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:53.046+0000 7fe306ffd700 1 --2- 172.21.15.57:0/1843109889 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fe2f4034910 0x7fe2f4036dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:53.049 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:53.046+0000 7fe306ffd700 1 --2- 172.21.15.57:0/1843109889 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fe2f4034910 0x7fe2f4036dc0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc006ee0 tx=0x7fe2fc008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:53.053 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:53.050+0000 7fe2effff700 1 -- 172.21.15.57:0/1843109889 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe2f80196b0 con 0x7fe308095eb0 2023-03-03T07:46:53.259 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:53.254+0000 7fe30c928700 1 -- 172.21.15.57:0/1843109889 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sub_0", "snap_name": "snap_0", "target_sub_name": "clone_9", "target": ["mon-mgr", ""]}) v1 -- 0x7fe3080619b0 con 0x7fe2f4034910 2023-03-03T07:46:55.127 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:55.122+0000 7fe2effff700 1 -- 172.21.15.57:0/1843109889 <== mgr.4099 v2:172.21.15.57:6808/28565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fe3080619b0 con 0x7fe2f4034910 2023-03-03T07:46:55.314 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:55.310+0000 7fe30c928700 1 -- 172.21.15.57:0/1843109889 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 1: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sub_0", "snap_name": "snap_0", "target_sub_name": "clone_9", "target": ["mon-mgr", ""]}) v1 -- 0x7fe3080716d0 con 0x7fe2f4034910 2023-03-03T07:46:55.340 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:46:55.338+0000 7fde62304700 -1 mgr.server reply reply (17) File exists subvolume 'clone_9' exists 2023-03-03T07:46:55.340 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:55.338+0000 7fe2effff700 1 -- 172.21.15.57:0/1843109889 <== mgr.4099 v2:172.21.15.57:6808/28565 2 ==== mgr_command_reply(tid 1: -17 subvolume 'clone_9' exists) v1 ==== 34+0+0 (secure 0 0 0) 0x7fe3080716d0 con 0x7fe2f4034910 2023-03-03T07:46:55.344 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:55.342+0000 7fe30c928700 1 -- 172.21.15.57:0/1843109889 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fe2f4034910 msgr2=0x7fe2f4036dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:55.345 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:55.342+0000 7fe30c928700 1 --2- 172.21.15.57:0/1843109889 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fe2f4034910 0x7fe2f4036dc0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc006ee0 tx=0x7fe2fc008030 comp rx=0 tx=0).stop 2023-03-03T07:46:55.345 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:55.342+0000 7fe30c928700 1 -- 172.21.15.57:0/1843109889 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe308095eb0 msgr2=0x7fe3081bab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:55.345 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:55.342+0000 7fe30c928700 1 --2- 172.21.15.57:0/1843109889 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe308095eb0 0x7fe3081bab00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe2f800c680 tx=0x7fe2f800ca40 comp rx=0 tx=0).stop 2023-03-03T07:46:55.345 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:55.342+0000 7fe30c928700 1 -- 172.21.15.57:0/1843109889 shutdown_connections 2023-03-03T07:46:55.346 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:55.342+0000 7fe30c928700 1 --2- 172.21.15.57:0/1843109889 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fe2f4034910 0x7fe2f4036dc0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:55.346 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:55.342+0000 7fe30c928700 1 --2- 172.21.15.57:0/1843109889 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe308095eb0 0x7fe3081bab00 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:55.346 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:55.342+0000 7fe30c928700 1 -- 172.21.15.57:0/1843109889 >> 172.21.15.57:0/1843109889 conn(0x7fe308094b00 msgr2=0x7fe3080911d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:46:55.346 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:55.342+0000 7fe30c928700 1 -- 172.21.15.57:0/1843109889 shutdown_connections 2023-03-03T07:46:55.347 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:55.342+0000 7fe30c928700 1 -- 172.21.15.57:0/1843109889 wait complete. 2023-03-03T07:46:55.350 INFO:tasks.workunit.client.0.smithi057.stderr:Second attempt of previously successful command failed with EEXIST: subvolume 'clone_9' exists 2023-03-03T07:46:55.350 INFO:tasks.workunit.client.0.smithi057.stderr:subvolume 'clone_9' exists 2023-03-03T07:46:55.382 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in $(eval echo {1..$NUM_CLONES}) 2023-03-03T07:46:55.383 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph fs subvolume snapshot clone cephfs sub_0 snap_0 clone_10 2023-03-03T07:46:55.579 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:55.578+0000 7ff9d359e700 1 Processor -- start 2023-03-03T07:46:55.580 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:55.578+0000 7ff9d359e700 1 -- start start 2023-03-03T07:46:55.580 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:55.578+0000 7ff9d359e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff9d4095eb0 0x7ff9d4123480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:55.580 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:55.578+0000 7ff9d359e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9d408d930 con 0x7ff9d408afb0 2023-03-03T07:46:55.581 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:55.578+0000 7ff9d359e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9d41242f0 con 0x7ff9d4095eb0 2023-03-03T07:46:55.581 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:55.578+0000 7ff9d259c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff9d4095eb0 0x7ff9d4123480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:55.581 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:55.578+0000 7ff9d1d9b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ff9d408afb0 0x7ff9d408b420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:43372/0 (socket says 172.21.15.57:43372) 2023-03-03T07:46:55.582 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:55.578+0000 7ff9d1d9b700 1 -- 172.21.15.57:0/1004303330 learned_addr learned my addr 172.21.15.57:0/1004303330 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:46:55.582 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:55.578+0000 7ff9d259c700 1 -- 172.21.15.57:0/1004303330 >> v1:172.21.15.57:6789/0 conn(0x7ff9d408afb0 legacy=0x7ff9d408b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:55.582 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:55.578+0000 7ff9d259c700 1 -- 172.21.15.57:0/1004303330 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d408bb30 con 0x7ff9d4095eb0 2023-03-03T07:46:55.583 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:55.578+0000 7ff9d259c700 1 --2- 172.21.15.57:0/1004303330 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9d4095eb0 0x7ff9d4123480 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff9c40097d0 tx=0x7ff9c4009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23b7956544848621 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:55.583 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:55.578+0000 7ff9d159a700 1 -- 172.21.15.57:0/1004303330 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff9c40041c0 con 0x7ff9d4095eb0 2023-03-03T07:46:55.583 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:55.582+0000 7ff9d159a700 1 -- 172.21.15.57:0/1004303330 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c4004320 con 0x7ff9d4095eb0 2023-03-03T07:46:55.583 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:55.582+0000 7ff9d159a700 1 -- 172.21.15.57:0/1004303330 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff9c40036c0 con 0x7ff9d4095eb0 2023-03-03T07:46:55.584 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:55.582+0000 7ff9d359e700 1 -- 172.21.15.57:0/1004303330 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9d4095eb0 msgr2=0x7ff9d4123480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:55.584 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:55.582+0000 7ff9d359e700 1 --2- 172.21.15.57:0/1004303330 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9d4095eb0 0x7ff9d4123480 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff9c40097d0 tx=0x7ff9c4009ae0 comp rx=0 tx=0).stop 2023-03-03T07:46:55.585 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:55.582+0000 7ff9d359e700 1 -- 172.21.15.57:0/1004303330 shutdown_connections 2023-03-03T07:46:55.585 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:55.582+0000 7ff9d359e700 1 --2- 172.21.15.57:0/1004303330 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9d4095eb0 0x7ff9d4123480 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:55.585 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:55.582+0000 7ff9d359e700 1 -- 172.21.15.57:0/1004303330 >> 172.21.15.57:0/1004303330 conn(0x7ff9d4094b00 msgr2=0x7ff9d4094ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:46:55.586 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:55.582+0000 7ff9d359e700 1 -- 172.21.15.57:0/1004303330 shutdown_connections 2023-03-03T07:46:55.586 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:55.582+0000 7ff9d359e700 1 -- 172.21.15.57:0/1004303330 wait complete. 2023-03-03T07:46:55.587 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:55.586+0000 7ff9d359e700 1 Processor -- start 2023-03-03T07:46:55.588 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:55.586+0000 7ff9d359e700 1 -- start start 2023-03-03T07:46:55.588 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:55.586+0000 7ff9d359e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9d408afb0 0x7ff9d41bb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:55.589 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:55.586+0000 7ff9d359e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d4120710 con 0x7ff9d408afb0 2023-03-03T07:46:55.589 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:55.586+0000 7ff9d259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9d408afb0 0x7ff9d41bb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:55.589 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:55.586+0000 7ff9d259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9d408afb0 0x7ff9d41bb0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59000/0 (socket says 172.21.15.57:59000) 2023-03-03T07:46:55.589 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:55.586+0000 7ff9d259c700 1 -- 172.21.15.57:0/4154384938 learned_addr learned my addr 172.21.15.57:0/4154384938 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:46:55.590 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:55.586+0000 7ff9d259c700 1 -- 172.21.15.57:0/4154384938 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c40094b0 con 0x7ff9d408afb0 2023-03-03T07:46:55.590 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:55.586+0000 7ff9d259c700 1 --2- 172.21.15.57:0/4154384938 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9d408afb0 0x7ff9d41bb0b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff9c4009b20 tx=0x7ff9c4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:55.591 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:55.586+0000 7ff9c2ffd700 1 -- 172.21.15.57:0/4154384938 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff9c4006ea0 con 0x7ff9d408afb0 2023-03-03T07:46:55.591 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:55.586+0000 7ff9c2ffd700 1 -- 172.21.15.57:0/4154384938 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c4011630 con 0x7ff9d408afb0 2023-03-03T07:46:55.591 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:55.586+0000 7ff9c2ffd700 1 -- 172.21.15.57:0/4154384938 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff9c40118d0 con 0x7ff9d408afb0 2023-03-03T07:46:55.591 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:55.586+0000 7ff9d359e700 1 -- 172.21.15.57:0/4154384938 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9d4123bf0 con 0x7ff9d408afb0 2023-03-03T07:46:55.592 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:55.590+0000 7ff9d359e700 1 -- 172.21.15.57:0/4154384938 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9d4123a60 con 0x7ff9d408afb0 2023-03-03T07:46:55.592 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:55.590+0000 7ff9c2ffd700 1 -- 172.21.15.57:0/4154384938 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 9) v1 ==== 42325+0+0 (secure 0 0 0) 0x7ff9c400f050 con 0x7ff9d408afb0 2023-03-03T07:46:55.593 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:55.590+0000 7ff9d359e700 1 -- 172.21.15.57:0/4154384938 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9d4123d80 con 0x7ff9d408afb0 2023-03-03T07:46:55.593 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:55.590+0000 7ff9c2ffd700 1 --2- 172.21.15.57:0/4154384938 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7ff9b4034910 0x7ff9b4036dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:55.594 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:55.590+0000 7ff9c2ffd700 1 -- 172.21.15.57:0/4154384938 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 2928+0+0 (secure 0 0 0) 0x7ff9c40474b0 con 0x7ff9d408afb0 2023-03-03T07:46:55.594 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:55.590+0000 7ff9d1d9b700 1 --2- 172.21.15.57:0/4154384938 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7ff9b4034910 0x7ff9b4036dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:55.595 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:55.590+0000 7ff9d1d9b700 1 --2- 172.21.15.57:0/4154384938 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7ff9b4034910 0x7ff9b4036dc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff9c80016a0 tx=0x7ff9c8007b70 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:55.600 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:55.598+0000 7ff9c2ffd700 1 -- 172.21.15.57:0/4154384938 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff9c400b740 con 0x7ff9d408afb0 2023-03-03T07:46:55.884 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:55.882+0000 7ff9d359e700 1 -- 172.21.15.57:0/4154384938 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sub_0", "snap_name": "snap_0", "target_sub_name": "clone_10", "target": ["mon-mgr", ""]}) v1 -- 0x7ff9d4122300 con 0x7ff9b4034910 2023-03-03T07:46:55.995 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:55.990+0000 7ff9c2ffd700 1 -- 172.21.15.57:0/4154384938 <== mgr.4099 v2:172.21.15.57:6808/28565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7ff9d4122300 con 0x7ff9b4034910 2023-03-03T07:46:56.181 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:56.178+0000 7ff9d359e700 1 -- 172.21.15.57:0/4154384938 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 1: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sub_0", "snap_name": "snap_0", "target_sub_name": "clone_10", "target": ["mon-mgr", ""]}) v1 -- 0x7ff9d4120850 con 0x7ff9b4034910 2023-03-03T07:46:56.208 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:46:56.206+0000 7fde62304700 -1 mgr.server reply reply (17) File exists subvolume 'clone_10' exists 2023-03-03T07:46:56.209 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:56.206+0000 7ff9c2ffd700 1 -- 172.21.15.57:0/4154384938 <== mgr.4099 v2:172.21.15.57:6808/28565 2 ==== mgr_command_reply(tid 1: -17 subvolume 'clone_10' exists) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff9d4120850 con 0x7ff9b4034910 2023-03-03T07:46:56.211 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:56.210+0000 7ff9d359e700 1 -- 172.21.15.57:0/4154384938 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7ff9b4034910 msgr2=0x7ff9b4036dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:56.212 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:56.210+0000 7ff9d359e700 1 --2- 172.21.15.57:0/4154384938 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7ff9b4034910 0x7ff9b4036dc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff9c80016a0 tx=0x7ff9c8007b70 comp rx=0 tx=0).stop 2023-03-03T07:46:56.212 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:56.210+0000 7ff9d359e700 1 -- 172.21.15.57:0/4154384938 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9d408afb0 msgr2=0x7ff9d41bb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:56.212 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:56.210+0000 7ff9d359e700 1 --2- 172.21.15.57:0/4154384938 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9d408afb0 0x7ff9d41bb0b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff9c4009b20 tx=0x7ff9c4004770 comp rx=0 tx=0).stop 2023-03-03T07:46:56.212 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:56.210+0000 7ff9d359e700 1 -- 172.21.15.57:0/4154384938 shutdown_connections 2023-03-03T07:46:56.212 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:56.210+0000 7ff9d359e700 1 --2- 172.21.15.57:0/4154384938 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7ff9b4034910 0x7ff9b4036dc0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:56.213 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:56.210+0000 7ff9d359e700 1 --2- 172.21.15.57:0/4154384938 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9d408afb0 0x7ff9d41bb0b0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:56.213 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:56.210+0000 7ff9d359e700 1 -- 172.21.15.57:0/4154384938 >> 172.21.15.57:0/4154384938 conn(0x7ff9d4094b00 msgr2=0x7ff9d40911c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:46:56.213 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:56.210+0000 7ff9d359e700 1 -- 172.21.15.57:0/4154384938 shutdown_connections 2023-03-03T07:46:56.213 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:56.210+0000 7ff9d359e700 1 -- 172.21.15.57:0/4154384938 wait complete. 2023-03-03T07:46:56.215 INFO:tasks.workunit.client.0.smithi057.stderr:Second attempt of previously successful command failed with EEXIST: subvolume 'clone_10' exists 2023-03-03T07:46:56.215 INFO:tasks.workunit.client.0.smithi057.stderr:subvolume 'clone_10' exists 2023-03-03T07:46:56.244 INFO:tasks.workunit.client.0.smithi057.stderr:+ timeout=90 2023-03-03T07:46:56.244 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 90 -gt 0 ']' 2023-03-03T07:46:56.245 INFO:tasks.workunit.client.0.smithi057.stderr:++ ceph health detail 2023-03-03T07:46:56.438 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:56.434+0000 7ff9aa777700 1 Processor -- start 2023-03-03T07:46:56.438 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:56.434+0000 7ff9aa777700 1 -- start start 2023-03-03T07:46:56.439 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:56.434+0000 7ff9aa777700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff9a4091de0 0x7ff9a408ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:56.439 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:56.438+0000 7ff9aa777700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9a40911f0 con 0x7ff9a4091a10 2023-03-03T07:46:56.439 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:56.438+0000 7ff9aa777700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9a40662f0 con 0x7ff9a4091de0 2023-03-03T07:46:56.440 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:56.438+0000 7ff9a8f74700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff9a4091de0 0x7ff9a408ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:56.440 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:56.438+0000 7ff9a9775700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ff9a4091a10 0x7ff9a408e730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:43378/0 (socket says 172.21.15.57:43378) 2023-03-03T07:46:56.440 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:56.438+0000 7ff9a9775700 1 -- 172.21.15.57:0/3195059236 learned_addr learned my addr 172.21.15.57:0/3195059236 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:46:56.441 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:56.438+0000 7ff99bfff700 1 -- 172.21.15.57:0/3195059236 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3323962983 0 0) 0x7ff9a40911f0 con 0x7ff9a4091a10 2023-03-03T07:46:56.441 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:56.438+0000 7ff99bfff700 1 -- 172.21.15.57:0/3195059236 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9900035d0 con 0x7ff9a4091a10 2023-03-03T07:46:56.441 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:56.438+0000 7ff9a8f74700 1 -- 172.21.15.57:0/3195059236 >> v1:172.21.15.57:6789/0 conn(0x7ff9a4091a10 legacy=0x7ff9a408e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:56.442 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:56.438+0000 7ff9a8f74700 1 -- 172.21.15.57:0/3195059236 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a4066700 con 0x7ff9a4091de0 2023-03-03T07:46:56.442 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:56.438+0000 7ff9a8f74700 1 --2- 172.21.15.57:0/3195059236 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9a4091de0 0x7ff9a408ee40 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff9940097d0 tx=0x7ff994009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4329ea82dd1fdcb6 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:56.442 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:56.438+0000 7ff99bfff700 1 -- 172.21.15.57:0/3195059236 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff994004160 con 0x7ff9a4091de0 2023-03-03T07:46:56.442 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:56.438+0000 7ff99bfff700 1 -- 172.21.15.57:0/3195059236 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9940042c0 con 0x7ff9a4091de0 2023-03-03T07:46:56.443 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:56.438+0000 7ff99bfff700 1 -- 172.21.15.57:0/3195059236 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff994004580 con 0x7ff9a4091de0 2023-03-03T07:46:56.443 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:56.442+0000 7ff9aa777700 1 -- 172.21.15.57:0/3195059236 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9a4091de0 msgr2=0x7ff9a408ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:56.443 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:56.442+0000 7ff9aa777700 1 --2- 172.21.15.57:0/3195059236 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9a4091de0 0x7ff9a408ee40 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff9940097d0 tx=0x7ff994009ae0 comp rx=0 tx=0).stop 2023-03-03T07:46:56.444 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:56.442+0000 7ff9aa777700 1 -- 172.21.15.57:0/3195059236 shutdown_connections 2023-03-03T07:46:56.444 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:56.442+0000 7ff9aa777700 1 --2- 172.21.15.57:0/3195059236 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9a4091de0 0x7ff9a408ee40 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:56.444 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:56.442+0000 7ff9aa777700 1 -- 172.21.15.57:0/3195059236 >> 172.21.15.57:0/3195059236 conn(0x7ff9a408a3c0 msgr2=0x7ff9a408c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:46:56.445 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:56.442+0000 7ff9aa777700 1 -- 172.21.15.57:0/3195059236 shutdown_connections 2023-03-03T07:46:56.445 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:56.442+0000 7ff9aa777700 1 -- 172.21.15.57:0/3195059236 wait complete. 2023-03-03T07:46:56.448 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:56.446+0000 7ff9aa777700 1 Processor -- start 2023-03-03T07:46:56.448 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:56.446+0000 7ff9aa777700 1 -- start start 2023-03-03T07:46:56.449 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:56.446+0000 7ff9aa777700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9a4091a10 0x7ff9a41bbec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:56.449 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:56.446+0000 7ff9aa777700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a411e980 con 0x7ff9a4091a10 2023-03-03T07:46:56.450 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:56.446+0000 7ff9a9775700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9a4091a10 0x7ff9a41bbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:56.450 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:56.446+0000 7ff9a9775700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9a4091a10 0x7ff9a41bbec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59024/0 (socket says 172.21.15.57:59024) 2023-03-03T07:46:56.450 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:56.446+0000 7ff9a9775700 1 -- 172.21.15.57:0/1723538915 learned_addr learned my addr 172.21.15.57:0/1723538915 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:46:56.451 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:56.446+0000 7ff9a9775700 1 -- 172.21.15.57:0/1723538915 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9940094b0 con 0x7ff9a4091a10 2023-03-03T07:46:56.451 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:56.446+0000 7ff9a9775700 1 --2- 172.21.15.57:0/1723538915 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9a4091a10 0x7ff9a41bbec0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff9a000c4d0 tx=0x7ff9a000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:56.451 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:56.450+0000 7ff999ffb700 1 -- 172.21.15.57:0/1723538915 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff9a0004bd0 con 0x7ff9a4091a10 2023-03-03T07:46:56.451 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:56.450+0000 7ff999ffb700 1 -- 172.21.15.57:0/1723538915 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a0004d50 con 0x7ff9a4091a10 2023-03-03T07:46:56.452 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:56.450+0000 7ff999ffb700 1 -- 172.21.15.57:0/1723538915 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff9a00070d0 con 0x7ff9a4091a10 2023-03-03T07:46:56.452 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:56.450+0000 7ff9aa777700 1 -- 172.21.15.57:0/1723538915 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9a4090f00 con 0x7ff9a4091a10 2023-03-03T07:46:56.452 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:56.450+0000 7ff9aa777700 1 -- 172.21.15.57:0/1723538915 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9a408f590 con 0x7ff9a4091a10 2023-03-03T07:46:56.454 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:56.450+0000 7ff9877fe700 1 -- 172.21.15.57:0/1723538915 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff980005310 con 0x7ff9a4091a10 2023-03-03T07:46:56.454 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:56.450+0000 7ff999ffb700 1 -- 172.21.15.57:0/1723538915 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 9) v1 ==== 42325+0+0 (secure 0 0 0) 0x7ff9a001a020 con 0x7ff9a4091a10 2023-03-03T07:46:56.455 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:56.454+0000 7ff999ffb700 1 --2- 172.21.15.57:0/1723538915 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7ff988034960 0x7ff988036e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:56.455 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:56.454+0000 7ff999ffb700 1 -- 172.21.15.57:0/1723538915 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 2928+0+0 (secure 0 0 0) 0x7ff9a0045eb0 con 0x7ff9a4091a10 2023-03-03T07:46:56.456 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:56.454+0000 7ff9a8f74700 1 --2- 172.21.15.57:0/1723538915 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7ff988034960 0x7ff988036e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:56.457 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:56.454+0000 7ff9a8f74700 1 --2- 172.21.15.57:0/1723538915 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7ff988034960 0x7ff988036e10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff9940097d0 tx=0x7ff994008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:56.461 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:56.458+0000 7ff999ffb700 1 -- 172.21.15.57:0/1723538915 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff9a001bb70 con 0x7ff9a4091a10 2023-03-03T07:46:56.788 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:56.786+0000 7ff9877fe700 1 -- 172.21.15.57:0/1723538915 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff9800055c0 con 0x7ff9a4091a10 2023-03-03T07:46:56.789 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:56.786+0000 7ff999ffb700 1 -- 172.21.15.57:0/1723538915 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7ff9a001b340 con 0x7ff9a4091a10 2023-03-03T07:46:57.006 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:57.002+0000 7ff9877fe700 1 -- 172.21.15.57:0/1723538915 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff980005b40 con 0x7ff9a4091a10 2023-03-03T07:46:57.006 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:57.002+0000 7ff999ffb700 1 -- 172.21.15.57:0/1723538915 <== mon.0 v2:172.21.15.57:3300/0 8 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7ff9a001b990 con 0x7ff9a4091a10 2023-03-03T07:46:57.011 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:57.006+0000 7ff9877fe700 1 -- 172.21.15.57:0/1723538915 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7ff988034960 msgr2=0x7ff988036e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:57.011 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:57.006+0000 7ff9877fe700 1 --2- 172.21.15.57:0/1723538915 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7ff988034960 0x7ff988036e10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff9940097d0 tx=0x7ff994008030 comp rx=0 tx=0).stop 2023-03-03T07:46:57.011 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:57.006+0000 7ff9877fe700 1 -- 172.21.15.57:0/1723538915 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9a4091a10 msgr2=0x7ff9a41bbec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:57.012 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:57.006+0000 7ff9877fe700 1 --2- 172.21.15.57:0/1723538915 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9a4091a10 0x7ff9a41bbec0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff9a000c4d0 tx=0x7ff9a000c890 comp rx=0 tx=0).stop 2023-03-03T07:46:57.012 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:57.006+0000 7ff9877fe700 1 -- 172.21.15.57:0/1723538915 shutdown_connections 2023-03-03T07:46:57.012 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:57.006+0000 7ff9877fe700 1 --2- 172.21.15.57:0/1723538915 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7ff988034960 0x7ff988036e10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:57.012 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:57.006+0000 7ff9877fe700 1 --2- 172.21.15.57:0/1723538915 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9a4091a10 0x7ff9a41bbec0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:57.012 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:57.006+0000 7ff9877fe700 1 -- 172.21.15.57:0/1723538915 >> 172.21.15.57:0/1723538915 conn(0x7ff9a408a3c0 msgr2=0x7ff9a412c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:46:57.012 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:57.010+0000 7ff9877fe700 1 -- 172.21.15.57:0/1723538915 shutdown_connections 2023-03-03T07:46:57.012 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:57.010+0000 7ff9877fe700 1 -- 172.21.15.57:0/1723538915 wait complete. 2023-03-03T07:46:57.047 INFO:tasks.workunit.client.0.smithi057.stderr:+ health=HEALTH_OK 2023-03-03T07:46:57.047 INFO:tasks.workunit.client.0.smithi057.stderr:+ [[ HEALTH_OK = *\O\S\D\_\F\U\L\L* ]] 2023-03-03T07:46:57.048 INFO:tasks.workunit.client.0.smithi057.stdout:Wating for osd to be full: 90 2023-03-03T07:46:57.048 INFO:tasks.workunit.client.0.smithi057.stderr:+ echo 'Wating for osd to be full: 90' 2023-03-03T07:46:57.048 INFO:tasks.workunit.client.0.smithi057.stderr:+ sleep 1 2023-03-03T07:46:58.053 INFO:tasks.workunit.client.0.smithi057.stderr:+ let timeout-=1 2023-03-03T07:46:58.053 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 89 -gt 0 ']' 2023-03-03T07:46:58.055 INFO:tasks.workunit.client.0.smithi057.stderr:++ ceph health detail 2023-03-03T07:46:58.221 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:58.218+0000 7f0be2ee8700 1 Processor -- start 2023-03-03T07:46:58.221 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:58.218+0000 7f0be2ee8700 1 -- start start 2023-03-03T07:46:58.222 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:58.218+0000 7f0be2ee8700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0bdc091de0 0x7f0bdc08ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:58.223 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:58.218+0000 7f0be2ee8700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bdc0911f0 con 0x7f0bdc091a10 2023-03-03T07:46:58.223 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:58.218+0000 7f0be2ee8700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bdc0662f0 con 0x7f0bdc091de0 2023-03-03T07:46:58.223 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:58.222+0000 7f0be1ee6700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f0bdc091a10 0x7f0bdc08e730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:43384/0 (socket says 172.21.15.57:43384) 2023-03-03T07:46:58.224 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:58.222+0000 7f0be1ee6700 1 -- 172.21.15.57:0/2315730461 learned_addr learned my addr 172.21.15.57:0/2315730461 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:46:58.224 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:58.222+0000 7f0be16e5700 1 --2- 172.21.15.57:0/2315730461 >> v2:172.21.15.57:3300/0 conn(0x7f0bdc091de0 0x7f0bdc08ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:58.224 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:58.222+0000 7f0be0ee4700 1 -- 172.21.15.57:0/2315730461 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3542765863 0 0) 0x7f0bdc0911f0 con 0x7f0bdc091a10 2023-03-03T07:46:58.225 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:58.222+0000 7f0be0ee4700 1 -- 172.21.15.57:0/2315730461 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bc80035d0 con 0x7f0bdc091a10 2023-03-03T07:46:58.225 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:58.222+0000 7f0be16e5700 1 -- 172.21.15.57:0/2315730461 >> v1:172.21.15.57:6789/0 conn(0x7f0bdc091a10 legacy=0x7f0bdc08e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:58.225 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:58.222+0000 7f0be16e5700 1 -- 172.21.15.57:0/2315730461 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bdc066700 con 0x7f0bdc091de0 2023-03-03T07:46:58.225 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:58.222+0000 7f0be16e5700 1 --2- 172.21.15.57:0/2315730461 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bdc091de0 0x7f0bdc08ee40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc0097d0 tx=0x7f0bcc009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=407e299eb3c56c11 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:58.226 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:58.222+0000 7f0be0ee4700 1 -- 172.21.15.57:0/2315730461 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0bcc004160 con 0x7f0bdc091de0 2023-03-03T07:46:58.226 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:58.222+0000 7f0be0ee4700 1 -- 172.21.15.57:0/2315730461 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bcc0042c0 con 0x7f0bdc091de0 2023-03-03T07:46:58.226 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:58.222+0000 7f0be0ee4700 1 -- 172.21.15.57:0/2315730461 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0bcc004580 con 0x7f0bdc091de0 2023-03-03T07:46:58.227 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:58.226+0000 7f0be2ee8700 1 -- 172.21.15.57:0/2315730461 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bdc091de0 msgr2=0x7f0bdc08ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:58.227 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:58.226+0000 7f0be2ee8700 1 --2- 172.21.15.57:0/2315730461 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bdc091de0 0x7f0bdc08ee40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc0097d0 tx=0x7f0bcc009ae0 comp rx=0 tx=0).stop 2023-03-03T07:46:58.227 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:58.226+0000 7f0be2ee8700 1 -- 172.21.15.57:0/2315730461 shutdown_connections 2023-03-03T07:46:58.228 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:58.226+0000 7f0be2ee8700 1 --2- 172.21.15.57:0/2315730461 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bdc091de0 0x7f0bdc08ee40 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:58.228 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:58.226+0000 7f0be2ee8700 1 -- 172.21.15.57:0/2315730461 >> 172.21.15.57:0/2315730461 conn(0x7f0bdc08a3c0 msgr2=0x7f0bdc08c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:46:58.229 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:58.226+0000 7f0be2ee8700 1 -- 172.21.15.57:0/2315730461 shutdown_connections 2023-03-03T07:46:58.229 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:58.226+0000 7f0be2ee8700 1 -- 172.21.15.57:0/2315730461 wait complete. 2023-03-03T07:46:58.231 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:58.230+0000 7f0be2ee8700 1 Processor -- start 2023-03-03T07:46:58.232 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:58.230+0000 7f0be2ee8700 1 -- start start 2023-03-03T07:46:58.233 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:58.230+0000 7f0be2ee8700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bdc091a10 0x7f0bdc121540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:58.233 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:58.230+0000 7f0be2ee8700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc124fd0 con 0x7f0bdc091a10 2023-03-03T07:46:58.233 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:58.230+0000 7f0be1ee6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bdc091a10 0x7f0bdc121540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:58.234 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:58.230+0000 7f0be1ee6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bdc091a10 0x7f0bdc121540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59050/0 (socket says 172.21.15.57:59050) 2023-03-03T07:46:58.234 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:58.230+0000 7f0be1ee6700 1 -- 172.21.15.57:0/3938360166 learned_addr learned my addr 172.21.15.57:0/3938360166 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:46:58.234 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:58.230+0000 7f0be1ee6700 1 -- 172.21.15.57:0/3938360166 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bcc0094b0 con 0x7f0bdc091a10 2023-03-03T07:46:58.234 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:58.230+0000 7f0be1ee6700 1 --2- 172.21.15.57:0/3938360166 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bdc091a10 0x7f0bdc121540 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0bd800c470 tx=0x7f0bd800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:58.235 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:58.230+0000 7f0bd27fc700 1 -- 172.21.15.57:0/3938360166 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0bd8005cc0 con 0x7f0bdc091a10 2023-03-03T07:46:58.235 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:58.230+0000 7f0bd27fc700 1 -- 172.21.15.57:0/3938360166 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bd8005e20 con 0x7f0bdc091a10 2023-03-03T07:46:58.235 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:58.230+0000 7f0bd27fc700 1 -- 172.21.15.57:0/3938360166 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0bd8007220 con 0x7f0bdc091a10 2023-03-03T07:46:58.236 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:58.230+0000 7f0be2ee8700 1 -- 172.21.15.57:0/3938360166 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bdc090f00 con 0x7f0bdc091a10 2023-03-03T07:46:58.236 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:58.234+0000 7f0be2ee8700 1 -- 172.21.15.57:0/3938360166 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bdc08f590 con 0x7f0bdc091a10 2023-03-03T07:46:58.236 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:58.234+0000 7f0bd27fc700 1 -- 172.21.15.57:0/3938360166 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 9) v1 ==== 42325+0+0 (secure 0 0 0) 0x7f0bd8019030 con 0x7f0bdc091a10 2023-03-03T07:46:58.237 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:58.234+0000 7f0be2ee8700 1 -- 172.21.15.57:0/3938360166 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bdc1243c0 con 0x7f0bdc091a10 2023-03-03T07:46:58.238 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:58.234+0000 7f0bd27fc700 1 --2- 172.21.15.57:0/3938360166 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f0bc0034950 0x7f0bc0036e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:58.238 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:58.234+0000 7f0bd27fc700 1 -- 172.21.15.57:0/3938360166 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 2928+0+0 (secure 0 0 0) 0x7f0bd80456c0 con 0x7f0bdc091a10 2023-03-03T07:46:58.238 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:58.234+0000 7f0be16e5700 1 --2- 172.21.15.57:0/3938360166 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f0bc0034950 0x7f0bc0036e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:58.239 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:58.238+0000 7f0be16e5700 1 --2- 172.21.15.57:0/3938360166 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f0bc0034950 0x7f0bc0036e00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc0097d0 tx=0x7f0bcc008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:58.245 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:58.242+0000 7f0bd27fc700 1 -- 172.21.15.57:0/3938360166 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f0bd80192c0 con 0x7f0bdc091a10 2023-03-03T07:46:58.489 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:58.486+0000 7f0be2ee8700 1 -- 172.21.15.57:0/3938360166 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f0bdc123c70 con 0x7f0bdc091a10 2023-03-03T07:46:58.490 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:58.486+0000 7f0bd27fc700 1 -- 172.21.15.57:0/3938360166 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f0bd8017070 con 0x7f0bdc091a10 2023-03-03T07:46:58.645 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:58.642+0000 7f0be2ee8700 1 -- 172.21.15.57:0/3938360166 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f0bdc12d6a0 con 0x7f0bdc091a10 2023-03-03T07:46:58.646 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:58.642+0000 7f0bd27fc700 1 -- 172.21.15.57:0/3938360166 <== mon.0 v2:172.21.15.57:3300/0 8 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f0bd80192c0 con 0x7f0bdc091a10 2023-03-03T07:46:58.652 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:58.650+0000 7f0be2ee8700 1 -- 172.21.15.57:0/3938360166 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f0bc0034950 msgr2=0x7f0bc0036e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:58.652 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:58.650+0000 7f0be2ee8700 1 --2- 172.21.15.57:0/3938360166 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f0bc0034950 0x7f0bc0036e00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc0097d0 tx=0x7f0bcc008030 comp rx=0 tx=0).stop 2023-03-03T07:46:58.652 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:58.650+0000 7f0be2ee8700 1 -- 172.21.15.57:0/3938360166 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bdc091a10 msgr2=0x7f0bdc121540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:58.652 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:58.650+0000 7f0be2ee8700 1 --2- 172.21.15.57:0/3938360166 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bdc091a10 0x7f0bdc121540 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0bd800c470 tx=0x7f0bd800c830 comp rx=0 tx=0).stop 2023-03-03T07:46:58.653 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:58.650+0000 7f0be2ee8700 1 -- 172.21.15.57:0/3938360166 shutdown_connections 2023-03-03T07:46:58.653 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:58.650+0000 7f0be2ee8700 1 --2- 172.21.15.57:0/3938360166 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f0bc0034950 0x7f0bc0036e00 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:58.653 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:58.650+0000 7f0be2ee8700 1 --2- 172.21.15.57:0/3938360166 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bdc091a10 0x7f0bdc121540 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:58.653 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:58.650+0000 7f0be2ee8700 1 -- 172.21.15.57:0/3938360166 >> 172.21.15.57:0/3938360166 conn(0x7f0bdc08a3c0 msgr2=0x7f0bdc08bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:46:58.654 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:58.650+0000 7f0be2ee8700 1 -- 172.21.15.57:0/3938360166 shutdown_connections 2023-03-03T07:46:58.654 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:58.650+0000 7f0be2ee8700 1 -- 172.21.15.57:0/3938360166 wait complete. 2023-03-03T07:46:58.676 INFO:tasks.workunit.client.0.smithi057.stderr:+ health=HEALTH_OK 2023-03-03T07:46:58.676 INFO:tasks.workunit.client.0.smithi057.stderr:+ [[ HEALTH_OK = *\O\S\D\_\F\U\L\L* ]] 2023-03-03T07:46:58.676 INFO:tasks.workunit.client.0.smithi057.stderr:+ echo 'Wating for osd to be full: 89' 2023-03-03T07:46:58.677 INFO:tasks.workunit.client.0.smithi057.stdout:Wating for osd to be full: 89 2023-03-03T07:46:58.677 INFO:tasks.workunit.client.0.smithi057.stderr:+ sleep 1 2023-03-03T07:46:59.683 INFO:tasks.workunit.client.0.smithi057.stderr:+ let timeout-=1 2023-03-03T07:46:59.683 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 88 -gt 0 ']' 2023-03-03T07:46:59.685 INFO:tasks.workunit.client.0.smithi057.stderr:++ ceph health detail 2023-03-03T07:46:59.852 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:59.850+0000 7fc49b082700 1 Processor -- start 2023-03-03T07:46:59.852 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:59.850+0000 7fc49b082700 1 -- start start 2023-03-03T07:46:59.855 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:59.850+0000 7fc49b082700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc494091de0 0x7fc49408ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:59.856 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:59.854+0000 7fc49987f700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc494091de0 0x7fc49408ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:59.856 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:59.854+0000 7fc49b082700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4940911f0 con 0x7fc494091a10 2023-03-03T07:46:59.856 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:59.854+0000 7fc49b082700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4940662f0 con 0x7fc494091de0 2023-03-03T07:46:59.857 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:59.854+0000 7fc49987f700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc494091de0 0x7fc49408ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59476/0 (socket says 172.21.15.57:59476) 2023-03-03T07:46:59.857 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:59.854+0000 7fc49987f700 1 -- 172.21.15.57:0/623243532 learned_addr learned my addr 172.21.15.57:0/623243532 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:46:59.857 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:59.854+0000 7fc49987f700 1 -- 172.21.15.57:0/623243532 >> v1:172.21.15.57:6789/0 conn(0x7fc494091a10 legacy=0x7fc49408e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:59.857 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:59.854+0000 7fc49987f700 1 -- 172.21.15.57:0/623243532 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc494066700 con 0x7fc494091de0 2023-03-03T07:46:59.858 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:59.854+0000 7fc49987f700 1 --2- 172.21.15.57:0/623243532 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc494091de0 0x7fc49408ee40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc484009890 tx=0x7fc484009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdf5e25d5becab48 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:59.859 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:59.854+0000 7fc49907e700 1 -- 172.21.15.57:0/623243532 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc484004160 con 0x7fc494091de0 2023-03-03T07:46:59.859 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:59.854+0000 7fc49907e700 1 -- 172.21.15.57:0/623243532 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4840042c0 con 0x7fc494091de0 2023-03-03T07:46:59.859 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:59.854+0000 7fc49907e700 1 -- 172.21.15.57:0/623243532 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc484004580 con 0x7fc494091de0 2023-03-03T07:46:59.860 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:59.858+0000 7fc49b082700 1 -- 172.21.15.57:0/623243532 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc494091de0 msgr2=0x7fc49408ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:46:59.860 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:59.858+0000 7fc49b082700 1 --2- 172.21.15.57:0/623243532 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc494091de0 0x7fc49408ee40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc484009890 tx=0x7fc484009ba0 comp rx=0 tx=0).stop 2023-03-03T07:46:59.861 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:59.858+0000 7fc49b082700 1 -- 172.21.15.57:0/623243532 shutdown_connections 2023-03-03T07:46:59.861 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:59.858+0000 7fc49b082700 1 --2- 172.21.15.57:0/623243532 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc494091de0 0x7fc49408ee40 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:46:59.861 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:59.858+0000 7fc49b082700 1 -- 172.21.15.57:0/623243532 >> 172.21.15.57:0/623243532 conn(0x7fc49408a3c0 msgr2=0x7fc49408c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:46:59.862 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:59.858+0000 7fc49b082700 1 -- 172.21.15.57:0/623243532 shutdown_connections 2023-03-03T07:46:59.862 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:59.858+0000 7fc49b082700 1 -- 172.21.15.57:0/623243532 wait complete. 2023-03-03T07:46:59.863 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:59.862+0000 7fc49b082700 1 Processor -- start 2023-03-03T07:46:59.864 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:59.862+0000 7fc49b082700 1 -- start start 2023-03-03T07:46:59.865 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:59.862+0000 7fc49b082700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc494091a10 0x7fc49411cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:59.865 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:59.862+0000 7fc49b082700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc49411f190 con 0x7fc494091a10 2023-03-03T07:46:59.865 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:59.862+0000 7fc49a080700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc494091a10 0x7fc49411cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:59.866 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:59.862+0000 7fc49a080700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc494091a10 0x7fc49411cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59480/0 (socket says 172.21.15.57:59480) 2023-03-03T07:46:59.866 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:59.862+0000 7fc49a080700 1 -- 172.21.15.57:0/246545516 learned_addr learned my addr 172.21.15.57:0/246545516 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:46:59.866 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:59.862+0000 7fc49a080700 1 -- 172.21.15.57:0/246545516 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc484009570 con 0x7fc494091a10 2023-03-03T07:46:59.866 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:59.862+0000 7fc49a080700 1 --2- 172.21.15.57:0/246545516 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc494091a10 0x7fc49411cac0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc49000c480 tx=0x7fc49000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:59.867 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:59.862+0000 7fc48affd700 1 -- 172.21.15.57:0/246545516 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc490005150 con 0x7fc494091a10 2023-03-03T07:46:59.867 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:59.862+0000 7fc48affd700 1 -- 172.21.15.57:0/246545516 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4900052b0 con 0x7fc494091a10 2023-03-03T07:46:59.867 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:59.862+0000 7fc48affd700 1 -- 172.21.15.57:0/246545516 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc490005590 con 0x7fc494091a10 2023-03-03T07:46:59.868 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:59.862+0000 7fc49b082700 1 -- 172.21.15.57:0/246545516 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc494090f00 con 0x7fc494091a10 2023-03-03T07:46:59.868 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:59.866+0000 7fc49b082700 1 -- 172.21.15.57:0/246545516 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc49408f590 con 0x7fc494091a10 2023-03-03T07:46:59.869 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:59.866+0000 7fc49b082700 1 -- 172.21.15.57:0/246545516 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc49412d720 con 0x7fc494091a10 2023-03-03T07:46:59.869 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:59.866+0000 7fc48affd700 1 -- 172.21.15.57:0/246545516 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 9) v1 ==== 42325+0+0 (secure 0 0 0) 0x7fc490010050 con 0x7fc494091a10 2023-03-03T07:46:59.870 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:59.866+0000 7fc48affd700 1 --2- 172.21.15.57:0/246545516 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fc478034910 0x7fc478036dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:46:59.870 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:59.866+0000 7fc48affd700 1 -- 172.21.15.57:0/246545516 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 2928+0+0 (secure 0 0 0) 0x7fc4900454f0 con 0x7fc494091a10 2023-03-03T07:46:59.870 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:59.866+0000 7fc49987f700 1 --2- 172.21.15.57:0/246545516 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fc478034910 0x7fc478036dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:46:59.871 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:59.866+0000 7fc49987f700 1 --2- 172.21.15.57:0/246545516 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fc478034910 0x7fc478036dc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc484009890 tx=0x7fc484008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:46:59.876 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:46:59.874+0000 7fc48affd700 1 -- 172.21.15.57:0/246545516 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc4900106f0 con 0x7fc494091a10 2023-03-03T07:47:00.150 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:00.146+0000 7fc49b082700 1 -- 172.21.15.57:0/246545516 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc49411e1a0 con 0x7fc494091a10 2023-03-03T07:47:00.151 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:00.146+0000 7fc48affd700 1 -- 172.21.15.57:0/246545516 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fc490019310 con 0x7fc494091a10 2023-03-03T07:47:00.356 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:00.354+0000 7fc49b082700 1 -- 172.21.15.57:0/246545516 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc4940619b0 con 0x7fc494091a10 2023-03-03T07:47:00.356 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:00.354+0000 7fc48affd700 1 -- 172.21.15.57:0/246545516 <== mon.0 v2:172.21.15.57:3300/0 8 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fc4900102e0 con 0x7fc494091a10 2023-03-03T07:47:00.359 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:00.358+0000 7fc49b082700 1 -- 172.21.15.57:0/246545516 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fc478034910 msgr2=0x7fc478036dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:00.360 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:00.358+0000 7fc49b082700 1 --2- 172.21.15.57:0/246545516 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fc478034910 0x7fc478036dc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc484009890 tx=0x7fc484008030 comp rx=0 tx=0).stop 2023-03-03T07:47:00.360 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:00.358+0000 7fc49b082700 1 -- 172.21.15.57:0/246545516 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc494091a10 msgr2=0x7fc49411cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:00.360 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:00.358+0000 7fc49b082700 1 --2- 172.21.15.57:0/246545516 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc494091a10 0x7fc49411cac0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc49000c480 tx=0x7fc49000c840 comp rx=0 tx=0).stop 2023-03-03T07:47:00.360 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:00.358+0000 7fc49b082700 1 -- 172.21.15.57:0/246545516 shutdown_connections 2023-03-03T07:47:00.360 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:00.358+0000 7fc49b082700 1 --2- 172.21.15.57:0/246545516 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fc478034910 0x7fc478036dc0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:00.360 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:00.358+0000 7fc49b082700 1 --2- 172.21.15.57:0/246545516 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc494091a10 0x7fc49411cac0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:00.360 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:00.358+0000 7fc49b082700 1 -- 172.21.15.57:0/246545516 >> 172.21.15.57:0/246545516 conn(0x7fc49408a3c0 msgr2=0x7fc49412cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:47:00.361 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:00.358+0000 7fc49b082700 1 -- 172.21.15.57:0/246545516 shutdown_connections 2023-03-03T07:47:00.361 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:00.358+0000 7fc49b082700 1 -- 172.21.15.57:0/246545516 wait complete. 2023-03-03T07:47:00.390 INFO:tasks.workunit.client.0.smithi057.stderr:+ health=HEALTH_OK 2023-03-03T07:47:00.390 INFO:tasks.workunit.client.0.smithi057.stderr:+ [[ HEALTH_OK = *\O\S\D\_\F\U\L\L* ]] 2023-03-03T07:47:00.391 INFO:tasks.workunit.client.0.smithi057.stderr:+ echo 'Wating for osd to be full: 88' 2023-03-03T07:47:00.391 INFO:tasks.workunit.client.0.smithi057.stdout:Wating for osd to be full: 88 2023-03-03T07:47:00.391 INFO:tasks.workunit.client.0.smithi057.stderr:+ sleep 1 2023-03-03T07:47:01.395 INFO:tasks.workunit.client.0.smithi057.stderr:+ let timeout-=1 2023-03-03T07:47:01.396 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 87 -gt 0 ']' 2023-03-03T07:47:01.397 INFO:tasks.workunit.client.0.smithi057.stderr:++ ceph health detail 2023-03-03T07:47:01.569 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:01.566+0000 7f8d00bcb700 1 Processor -- start 2023-03-03T07:47:01.569 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:01.566+0000 7f8d00bcb700 1 -- start start 2023-03-03T07:47:01.570 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:01.566+0000 7f8d00bcb700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8cfc08e620 0x7f8cfc08e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:01.571 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:01.566+0000 7f8d00bcb700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cfc097240 con 0x7f8cfc08ef30 2023-03-03T07:47:01.571 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:01.566+0000 7f8d00bcb700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cfc06a430 con 0x7f8cfc08e620 2023-03-03T07:47:01.571 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:01.566+0000 7f8cfb7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8cfc08e620 0x7f8cfc08e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:01.572 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:01.566+0000 7f8cfb7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8cfc08e620 0x7f8cfc08e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59486/0 (socket says 172.21.15.57:59486) 2023-03-03T07:47:01.572 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:01.566+0000 7f8cfb7fe700 1 -- 172.21.15.57:0/4138972679 learned_addr learned my addr 172.21.15.57:0/4138972679 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:47:01.572 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:01.566+0000 7f8cfaffd700 1 --1- 172.21.15.57:0/4138972679 >> v1:172.21.15.57:6789/0 conn(0x7f8cfc08ef30 0x7f8cfc1278f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56892/0 (socket says 172.21.15.57:56892) 2023-03-03T07:47:01.573 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:01.570+0000 7f8cfb7fe700 1 -- 172.21.15.57:0/4138972679 >> v1:172.21.15.57:6789/0 conn(0x7f8cfc08ef30 legacy=0x7f8cfc1278f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:01.573 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:01.570+0000 7f8cfb7fe700 1 -- 172.21.15.57:0/4138972679 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cfc097550 con 0x7f8cfc08e620 2023-03-03T07:47:01.573 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:01.570+0000 7f8cfb7fe700 1 --2- 172.21.15.57:0/4138972679 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8cfc08e620 0x7f8cfc08e9f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8cec009890 tx=0x7f8cec009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1073f5321832df server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:01.574 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:01.570+0000 7f8cfa7fc700 1 -- 172.21.15.57:0/4138972679 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8cec004160 con 0x7f8cfc08e620 2023-03-03T07:47:01.574 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:01.570+0000 7f8cfa7fc700 1 -- 172.21.15.57:0/4138972679 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cec0042c0 con 0x7f8cfc08e620 2023-03-03T07:47:01.574 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:01.570+0000 7f8cfa7fc700 1 -- 172.21.15.57:0/4138972679 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8cec004580 con 0x7f8cfc08e620 2023-03-03T07:47:01.575 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:01.570+0000 7f8d00bcb700 1 -- 172.21.15.57:0/4138972679 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8cfc08e620 msgr2=0x7f8cfc08e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:01.575 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:01.570+0000 7f8d00bcb700 1 --2- 172.21.15.57:0/4138972679 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8cfc08e620 0x7f8cfc08e9f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8cec009890 tx=0x7f8cec009ba0 comp rx=0 tx=0).stop 2023-03-03T07:47:01.575 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:01.570+0000 7f8d00bcb700 1 -- 172.21.15.57:0/4138972679 shutdown_connections 2023-03-03T07:47:01.575 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:01.570+0000 7f8d00bcb700 1 --2- 172.21.15.57:0/4138972679 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8cfc08e620 0x7f8cfc08e9f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:01.576 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:01.570+0000 7f8d00bcb700 1 -- 172.21.15.57:0/4138972679 >> 172.21.15.57:0/4138972679 conn(0x7f8cfc095d80 msgr2=0x7f8cfc096180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:47:01.576 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:01.570+0000 7f8d00bcb700 1 -- 172.21.15.57:0/4138972679 shutdown_connections 2023-03-03T07:47:01.576 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:01.570+0000 7f8d00bcb700 1 -- 172.21.15.57:0/4138972679 wait complete. 2023-03-03T07:47:01.578 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:01.574+0000 7f8d00bcb700 1 Processor -- start 2023-03-03T07:47:01.578 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:01.574+0000 7f8d00bcb700 1 -- start start 2023-03-03T07:47:01.579 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:01.578+0000 7f8d00bcb700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8cfc08e620 0x7f8cfc1bbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:01.580 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:01.578+0000 7f8d00bcb700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cfc127bf0 con 0x7f8cfc08e620 2023-03-03T07:47:01.580 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:01.578+0000 7f8cfb7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8cfc08e620 0x7f8cfc1bbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:01.581 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:01.578+0000 7f8cfb7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8cfc08e620 0x7f8cfc1bbfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59494/0 (socket says 172.21.15.57:59494) 2023-03-03T07:47:01.581 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:01.578+0000 7f8cfb7fe700 1 -- 172.21.15.57:0/2969964694 learned_addr learned my addr 172.21.15.57:0/2969964694 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:47:01.582 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:01.578+0000 7f8cfb7fe700 1 -- 172.21.15.57:0/2969964694 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cec009570 con 0x7f8cfc08e620 2023-03-03T07:47:01.582 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:01.578+0000 7f8cfb7fe700 1 --2- 172.21.15.57:0/2969964694 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8cfc08e620 0x7f8cfc1bbfd0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8cec009be0 tx=0x7f8cec004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:01.582 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:01.578+0000 7f8ce3fff700 1 -- 172.21.15.57:0/2969964694 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8cec00b670 con 0x7f8cfc08e620 2023-03-03T07:47:01.582 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:01.578+0000 7f8ce3fff700 1 -- 172.21.15.57:0/2969964694 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cec00b7d0 con 0x7f8cfc08e620 2023-03-03T07:47:01.583 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:01.578+0000 7f8d00bcb700 1 -- 172.21.15.57:0/2969964694 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cfc1283e0 con 0x7f8cfc08e620 2023-03-03T07:47:01.583 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:01.578+0000 7f8ce3fff700 1 -- 172.21.15.57:0/2969964694 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8cec00ba70 con 0x7f8cfc08e620 2023-03-03T07:47:01.583 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:01.578+0000 7f8d00bcb700 1 -- 172.21.15.57:0/2969964694 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cfc128250 con 0x7f8cfc08e620 2023-03-03T07:47:01.584 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:01.582+0000 7f8ce3fff700 1 -- 172.21.15.57:0/2969964694 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 9) v1 ==== 42325+0+0 (secure 0 0 0) 0x7f8cec017020 con 0x7f8cfc08e620 2023-03-03T07:47:01.584 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:01.582+0000 7f8d00bcb700 1 -- 172.21.15.57:0/2969964694 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cfc128570 con 0x7f8cfc08e620 2023-03-03T07:47:01.585 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:01.582+0000 7f8ce3fff700 1 --2- 172.21.15.57:0/2969964694 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f8ce8034900 0x7f8ce8036db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:01.585 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:01.582+0000 7f8ce3fff700 1 -- 172.21.15.57:0/2969964694 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 2928+0+0 (secure 0 0 0) 0x7f8cec047f70 con 0x7f8cfc08e620 2023-03-03T07:47:01.585 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:01.582+0000 7f8cfaffd700 1 --2- 172.21.15.57:0/2969964694 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f8ce8034900 0x7f8ce8036db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:01.586 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:01.582+0000 7f8cfaffd700 1 --2- 172.21.15.57:0/2969964694 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f8ce8034900 0x7f8ce8036db0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0000f60 tx=0x7f8cf0007b30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:01.595 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:01.590+0000 7f8ce3fff700 1 -- 172.21.15.57:0/2969964694 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8cec006c80 con 0x7f8cfc08e620 2023-03-03T07:47:01.865 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:01.862+0000 7f8d00bcb700 1 -- 172.21.15.57:0/2969964694 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f8cfc0619b0 con 0x7f8cfc08e620 2023-03-03T07:47:01.866 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:01.862+0000 7f8ce3fff700 1 -- 172.21.15.57:0/2969964694 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f8cec019bb0 con 0x7f8cfc08e620 2023-03-03T07:47:02.057 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:02.054+0000 7f8d00bcb700 1 -- 172.21.15.57:0/2969964694 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f8cfc072140 con 0x7f8cfc08e620 2023-03-03T07:47:02.058 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:02.054+0000 7f8ce3fff700 1 -- 172.21.15.57:0/2969964694 <== mon.0 v2:172.21.15.57:3300/0 8 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f8cec006c80 con 0x7f8cfc08e620 2023-03-03T07:47:02.061 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:02.058+0000 7f8d00bcb700 1 -- 172.21.15.57:0/2969964694 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f8ce8034900 msgr2=0x7f8ce8036db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:02.061 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:02.058+0000 7f8d00bcb700 1 --2- 172.21.15.57:0/2969964694 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f8ce8034900 0x7f8ce8036db0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0000f60 tx=0x7f8cf0007b30 comp rx=0 tx=0).stop 2023-03-03T07:47:02.061 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:02.058+0000 7f8d00bcb700 1 -- 172.21.15.57:0/2969964694 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8cfc08e620 msgr2=0x7f8cfc1bbfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:02.062 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:02.058+0000 7f8d00bcb700 1 --2- 172.21.15.57:0/2969964694 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8cfc08e620 0x7f8cfc1bbfd0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8cec009be0 tx=0x7f8cec004770 comp rx=0 tx=0).stop 2023-03-03T07:47:02.062 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:02.058+0000 7f8d00bcb700 1 -- 172.21.15.57:0/2969964694 shutdown_connections 2023-03-03T07:47:02.062 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:02.058+0000 7f8d00bcb700 1 --2- 172.21.15.57:0/2969964694 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f8ce8034900 0x7f8ce8036db0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:02.062 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:02.058+0000 7f8d00bcb700 1 --2- 172.21.15.57:0/2969964694 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8cfc08e620 0x7f8cfc1bbfd0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:02.063 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:02.058+0000 7f8d00bcb700 1 -- 172.21.15.57:0/2969964694 >> 172.21.15.57:0/2969964694 conn(0x7f8cfc095d80 msgr2=0x7f8cfc129140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:47:02.063 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:02.058+0000 7f8d00bcb700 1 -- 172.21.15.57:0/2969964694 shutdown_connections 2023-03-03T07:47:02.063 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:02.058+0000 7f8d00bcb700 1 -- 172.21.15.57:0/2969964694 wait complete. 2023-03-03T07:47:02.088 INFO:tasks.workunit.client.0.smithi057.stderr:+ health=HEALTH_OK 2023-03-03T07:47:02.088 INFO:tasks.workunit.client.0.smithi057.stderr:+ [[ HEALTH_OK = *\O\S\D\_\F\U\L\L* ]] 2023-03-03T07:47:02.088 INFO:tasks.workunit.client.0.smithi057.stderr:+ echo 'Wating for osd to be full: 87' 2023-03-03T07:47:02.089 INFO:tasks.workunit.client.0.smithi057.stdout:Wating for osd to be full: 87 2023-03-03T07:47:02.089 INFO:tasks.workunit.client.0.smithi057.stderr:+ sleep 1 2023-03-03T07:47:03.096 INFO:tasks.workunit.client.0.smithi057.stderr:+ let timeout-=1 2023-03-03T07:47:03.096 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 86 -gt 0 ']' 2023-03-03T07:47:03.098 INFO:tasks.workunit.client.0.smithi057.stderr:++ ceph health detail 2023-03-03T07:47:03.266 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:03.262+0000 7fdfe0bce700 1 Processor -- start 2023-03-03T07:47:03.268 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:03.262+0000 7fdfe0bce700 1 -- start start 2023-03-03T07:47:03.269 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:03.266+0000 7fdfe0bce700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdfdc08ba90 0x7fdfdc128fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:03.269 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:03.266+0000 7fdfe0bce700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfdc08d260 con 0x7fdfdc08afb0 2023-03-03T07:47:03.269 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:03.266+0000 7fdfe0bce700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfdc071ca0 con 0x7fdfdc08ba90 2023-03-03T07:47:03.270 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:03.266+0000 7fdfdb7fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fdfdc08afb0 0x7fdfdc08b380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56906/0 (socket says 172.21.15.57:56906) 2023-03-03T07:47:03.270 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:03.266+0000 7fdfdb7fe700 1 -- 172.21.15.57:0/838358374 learned_addr learned my addr 172.21.15.57:0/838358374 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:47:03.270 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:03.266+0000 7fdfd2ffd700 1 --2- 172.21.15.57:0/838358374 >> v2:172.21.15.57:3300/0 conn(0x7fdfdc08ba90 0x7fdfdc128fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:03.270 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:03.266+0000 7fdfdaffd700 1 -- 172.21.15.57:0/838358374 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3278577449 0 0) 0x7fdfdc08d260 con 0x7fdfdc08afb0 2023-03-03T07:47:03.271 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:03.266+0000 7fdfdaffd700 1 -- 172.21.15.57:0/838358374 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfc80034f0 con 0x7fdfdc08afb0 2023-03-03T07:47:03.271 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:03.266+0000 7fdfd2ffd700 1 -- 172.21.15.57:0/838358374 >> v1:172.21.15.57:6789/0 conn(0x7fdfdc08afb0 legacy=0x7fdfdc08b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:03.271 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:03.266+0000 7fdfd2ffd700 1 -- 172.21.15.57:0/838358374 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfdc08d490 con 0x7fdfdc08ba90 2023-03-03T07:47:03.271 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:03.270+0000 7fdfd2ffd700 1 --2- 172.21.15.57:0/838358374 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdfdc08ba90 0x7fdfdc128fc0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fdfc40097d0 tx=0x7fdfc4009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d52fbf9f0f0f63 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:03.272 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:03.270+0000 7fdfdaffd700 1 -- 172.21.15.57:0/838358374 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdfc4004160 con 0x7fdfdc08ba90 2023-03-03T07:47:03.272 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:03.270+0000 7fdfdaffd700 1 -- 172.21.15.57:0/838358374 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc40042c0 con 0x7fdfdc08ba90 2023-03-03T07:47:03.272 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:03.270+0000 7fdfdaffd700 1 -- 172.21.15.57:0/838358374 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdfc4004580 con 0x7fdfdc08ba90 2023-03-03T07:47:03.274 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:03.270+0000 7fdfe0bce700 1 -- 172.21.15.57:0/838358374 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdfdc08ba90 msgr2=0x7fdfdc128fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:03.274 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:03.270+0000 7fdfe0bce700 1 --2- 172.21.15.57:0/838358374 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdfdc08ba90 0x7fdfdc128fc0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fdfc40097d0 tx=0x7fdfc4009ae0 comp rx=0 tx=0).stop 2023-03-03T07:47:03.274 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:03.270+0000 7fdfe0bce700 1 -- 172.21.15.57:0/838358374 shutdown_connections 2023-03-03T07:47:03.274 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:03.270+0000 7fdfe0bce700 1 --2- 172.21.15.57:0/838358374 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdfdc08ba90 0x7fdfdc128fc0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:03.274 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:03.270+0000 7fdfe0bce700 1 -- 172.21.15.57:0/838358374 >> 172.21.15.57:0/838358374 conn(0x7fdfdc0943e0 msgr2=0x7fdfdc095e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:47:03.274 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:03.270+0000 7fdfe0bce700 1 -- 172.21.15.57:0/838358374 shutdown_connections 2023-03-03T07:47:03.275 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:03.270+0000 7fdfe0bce700 1 -- 172.21.15.57:0/838358374 wait complete. 2023-03-03T07:47:03.275 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:03.274+0000 7fdfe0bce700 1 Processor -- start 2023-03-03T07:47:03.276 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:03.274+0000 7fdfe0bce700 1 -- start start 2023-03-03T07:47:03.277 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:03.274+0000 7fdfe0bce700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdfdc08afb0 0x7fdfdc06a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:03.277 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:03.274+0000 7fdfe0bce700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc06b8d0 con 0x7fdfdc08afb0 2023-03-03T07:47:03.277 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:03.274+0000 7fdfdb7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdfdc08afb0 0x7fdfdc06a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:03.278 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:03.274+0000 7fdfdb7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdfdc08afb0 0x7fdfdc06a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59510/0 (socket says 172.21.15.57:59510) 2023-03-03T07:47:03.278 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:03.274+0000 7fdfdb7fe700 1 -- 172.21.15.57:0/2173117972 learned_addr learned my addr 172.21.15.57:0/2173117972 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:47:03.278 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:03.274+0000 7fdfdb7fe700 1 -- 172.21.15.57:0/2173117972 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc40094b0 con 0x7fdfdc08afb0 2023-03-03T07:47:03.279 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:03.274+0000 7fdfdb7fe700 1 --2- 172.21.15.57:0/2173117972 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdfdc08afb0 0x7fdfdc06a6c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc00c470 tx=0x7fdfcc00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:03.280 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:03.274+0000 7fdfd8ff9700 1 -- 172.21.15.57:0/2173117972 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdfcc005cc0 con 0x7fdfdc08afb0 2023-03-03T07:47:03.280 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:03.274+0000 7fdfd8ff9700 1 -- 172.21.15.57:0/2173117972 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfcc005e20 con 0x7fdfdc08afb0 2023-03-03T07:47:03.280 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:03.274+0000 7fdfd8ff9700 1 -- 172.21.15.57:0/2173117972 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdfcc007220 con 0x7fdfdc08afb0 2023-03-03T07:47:03.280 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:03.274+0000 7fdfe0bce700 1 -- 172.21.15.57:0/2173117972 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfdc069f30 con 0x7fdfdc08afb0 2023-03-03T07:47:03.280 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:03.278+0000 7fdfe0bce700 1 -- 172.21.15.57:0/2173117972 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfdc069da0 con 0x7fdfdc08afb0 2023-03-03T07:47:03.281 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:03.278+0000 7fdfe0bce700 1 -- 172.21.15.57:0/2173117972 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfdc129500 con 0x7fdfdc08afb0 2023-03-03T07:47:03.281 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:03.278+0000 7fdfd8ff9700 1 -- 172.21.15.57:0/2173117972 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 9) v1 ==== 42325+0+0 (secure 0 0 0) 0x7fdfcc019030 con 0x7fdfdc08afb0 2023-03-03T07:47:03.283 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:03.278+0000 7fdfd8ff9700 1 --2- 172.21.15.57:0/2173117972 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fdfbc034900 0x7fdfbc036db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:03.283 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:03.282+0000 7fdfd8ff9700 1 -- 172.21.15.57:0/2173117972 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 2928+0+0 (secure 0 0 0) 0x7fdfcc0456c0 con 0x7fdfdc08afb0 2023-03-03T07:47:03.284 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:03.282+0000 7fdfd2ffd700 1 --2- 172.21.15.57:0/2173117972 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fdfbc034900 0x7fdfbc036db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:03.285 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:03.282+0000 7fdfd2ffd700 1 --2- 172.21.15.57:0/2173117972 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fdfbc034900 0x7fdfbc036db0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdfc40097d0 tx=0x7fdfc4008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:03.291 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:03.286+0000 7fdfd8ff9700 1 -- 172.21.15.57:0/2173117972 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fdfcc0192c0 con 0x7fdfdc08afb0 2023-03-03T07:47:03.528 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:03.526+0000 7fdfe0bce700 1 -- 172.21.15.57:0/2173117972 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fdfdc0619b0 con 0x7fdfdc08afb0 2023-03-03T07:47:03.529 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:03.526+0000 7fdfd8ff9700 1 -- 172.21.15.57:0/2173117972 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fdfcc017070 con 0x7fdfdc08afb0 2023-03-03T07:47:03.689 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:03.686+0000 7fdfe0bce700 1 -- 172.21.15.57:0/2173117972 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fdfdc0008d0 con 0x7fdfdc08afb0 2023-03-03T07:47:03.690 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:03.686+0000 7fdfd8ff9700 1 -- 172.21.15.57:0/2173117972 <== mon.0 v2:172.21.15.57:3300/0 8 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fdfcc0194a0 con 0x7fdfdc08afb0 2023-03-03T07:47:03.696 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:03.694+0000 7fdfe0bce700 1 -- 172.21.15.57:0/2173117972 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fdfbc034900 msgr2=0x7fdfbc036db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:03.696 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:03.694+0000 7fdfe0bce700 1 --2- 172.21.15.57:0/2173117972 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fdfbc034900 0x7fdfbc036db0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdfc40097d0 tx=0x7fdfc4008030 comp rx=0 tx=0).stop 2023-03-03T07:47:03.696 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:03.694+0000 7fdfe0bce700 1 -- 172.21.15.57:0/2173117972 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdfdc08afb0 msgr2=0x7fdfdc06a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:03.696 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:03.694+0000 7fdfe0bce700 1 --2- 172.21.15.57:0/2173117972 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdfdc08afb0 0x7fdfdc06a6c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc00c470 tx=0x7fdfcc00c830 comp rx=0 tx=0).stop 2023-03-03T07:47:03.697 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:03.694+0000 7fdfe0bce700 1 -- 172.21.15.57:0/2173117972 shutdown_connections 2023-03-03T07:47:03.697 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:03.694+0000 7fdfe0bce700 1 --2- 172.21.15.57:0/2173117972 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fdfbc034900 0x7fdfbc036db0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:03.697 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:03.694+0000 7fdfe0bce700 1 --2- 172.21.15.57:0/2173117972 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdfdc08afb0 0x7fdfdc06a6c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:03.698 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:03.694+0000 7fdfe0bce700 1 -- 172.21.15.57:0/2173117972 >> 172.21.15.57:0/2173117972 conn(0x7fdfdc0943e0 msgr2=0x7fdfdc070610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:47:03.698 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:03.694+0000 7fdfe0bce700 1 -- 172.21.15.57:0/2173117972 shutdown_connections 2023-03-03T07:47:03.698 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:03.694+0000 7fdfe0bce700 1 -- 172.21.15.57:0/2173117972 wait complete. 2023-03-03T07:47:03.724 INFO:tasks.workunit.client.0.smithi057.stderr:+ health=HEALTH_OK 2023-03-03T07:47:03.724 INFO:tasks.workunit.client.0.smithi057.stderr:+ [[ HEALTH_OK = *\O\S\D\_\F\U\L\L* ]] 2023-03-03T07:47:03.724 INFO:tasks.workunit.client.0.smithi057.stderr:+ echo 'Wating for osd to be full: 86' 2023-03-03T07:47:03.724 INFO:tasks.workunit.client.0.smithi057.stderr:+ sleep 1 2023-03-03T07:47:03.725 INFO:tasks.workunit.client.0.smithi057.stdout:Wating for osd to be full: 86 2023-03-03T07:47:04.492 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:47:04.730 INFO:tasks.workunit.client.0.smithi057.stderr:+ let timeout-=1 2023-03-03T07:47:04.730 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 85 -gt 0 ']' 2023-03-03T07:47:04.733 INFO:tasks.workunit.client.0.smithi057.stderr:++ ceph health detail 2023-03-03T07:47:04.897 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:04.894+0000 7f1791926700 1 Processor -- start 2023-03-03T07:47:04.898 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:04.894+0000 7f1791926700 1 -- start start 2023-03-03T07:47:04.898 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:04.894+0000 7f1791926700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f178c126c30 0x7f178c129010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:04.898 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:04.894+0000 7f1791926700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f178c06ca60 con 0x7f178c06adb0 2023-03-03T07:47:04.899 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:04.894+0000 7f1791926700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f178c06cc60 con 0x7f178c126c30 2023-03-03T07:47:04.899 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:04.894+0000 7f178a7fc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f178c126c30 0x7f178c129010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:04.899 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:04.894+0000 7f178a7fc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f178c126c30 0x7f178c129010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59520/0 (socket says 172.21.15.57:59520) 2023-03-03T07:47:04.900 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:04.894+0000 7f178a7fc700 1 -- 172.21.15.57:0/4219688730 learned_addr learned my addr 172.21.15.57:0/4219688730 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:47:04.900 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:04.894+0000 7f178affd700 1 --1- 172.21.15.57:0/4219688730 >> v1:172.21.15.57:6789/0 conn(0x7f178c06adb0 0x7f178c0918a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56914/0 (socket says 172.21.15.57:56914) 2023-03-03T07:47:04.900 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:04.898+0000 7f178a7fc700 1 -- 172.21.15.57:0/4219688730 >> v1:172.21.15.57:6789/0 conn(0x7f178c06adb0 legacy=0x7f178c0918a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:04.900 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:04.898+0000 7f178a7fc700 1 -- 172.21.15.57:0/4219688730 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f178c067960 con 0x7f178c126c30 2023-03-03T07:47:04.901 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:04.898+0000 7f178a7fc700 1 --2- 172.21.15.57:0/4219688730 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f178c126c30 0x7f178c129010 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f178000aa30 tx=0x7f178000ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5855231699920935 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:04.901 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:04.898+0000 7f1789ffb700 1 -- 172.21.15.57:0/4219688730 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f178000caa0 con 0x7f178c126c30 2023-03-03T07:47:04.901 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:04.898+0000 7f1789ffb700 1 -- 172.21.15.57:0/4219688730 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f178000cc00 con 0x7f178c126c30 2023-03-03T07:47:04.902 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:04.898+0000 7f1789ffb700 1 -- 172.21.15.57:0/4219688730 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1780004030 con 0x7f178c126c30 2023-03-03T07:47:04.902 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:04.898+0000 7f1791926700 1 -- 172.21.15.57:0/4219688730 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f178c126c30 msgr2=0x7f178c129010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:04.902 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:04.898+0000 7f1791926700 1 --2- 172.21.15.57:0/4219688730 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f178c126c30 0x7f178c129010 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f178000aa30 tx=0x7f178000ad40 comp rx=0 tx=0).stop 2023-03-03T07:47:04.902 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:04.898+0000 7f1791926700 1 -- 172.21.15.57:0/4219688730 shutdown_connections 2023-03-03T07:47:04.902 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:04.898+0000 7f1791926700 1 --2- 172.21.15.57:0/4219688730 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f178c126c30 0x7f178c129010 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:04.902 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:04.898+0000 7f1791926700 1 -- 172.21.15.57:0/4219688730 >> 172.21.15.57:0/4219688730 conn(0x7f178c0948d0 msgr2=0x7f178c096ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:47:04.903 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:04.898+0000 7f1791926700 1 -- 172.21.15.57:0/4219688730 shutdown_connections 2023-03-03T07:47:04.903 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:04.898+0000 7f1791926700 1 -- 172.21.15.57:0/4219688730 wait complete. 2023-03-03T07:47:04.903 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:04.898+0000 7f1791926700 1 Processor -- start 2023-03-03T07:47:04.904 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:04.902+0000 7f1791926700 1 -- start start 2023-03-03T07:47:04.904 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:04.902+0000 7f1791926700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f178c06adb0 0x7f178c1c0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:04.904 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:04.902+0000 7f1791926700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f178c1bfe10 con 0x7f178c06adb0 2023-03-03T07:47:04.905 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:04.902+0000 7f178affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f178c06adb0 0x7f178c1c0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:04.905 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:04.902+0000 7f178affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f178c06adb0 0x7f178c1c0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59524/0 (socket says 172.21.15.57:59524) 2023-03-03T07:47:04.905 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:04.902+0000 7f178affd700 1 -- 172.21.15.57:0/2801855034 learned_addr learned my addr 172.21.15.57:0/2801855034 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:47:04.905 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:04.902+0000 7f178affd700 1 -- 172.21.15.57:0/2801855034 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f178000a710 con 0x7f178c06adb0 2023-03-03T07:47:04.906 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:04.902+0000 7f178affd700 1 --2- 172.21.15.57:0/2801855034 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f178c06adb0 0x7f178c1c0320 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f177c00cbd0 tx=0x7f177c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:04.907 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:04.902+0000 7f1773fff700 1 -- 172.21.15.57:0/2801855034 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f177c00aa60 con 0x7f178c06adb0 2023-03-03T07:47:04.907 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:04.902+0000 7f1773fff700 1 -- 172.21.15.57:0/2801855034 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f177c00abc0 con 0x7f178c06adb0 2023-03-03T07:47:04.907 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:04.902+0000 7f1773fff700 1 -- 172.21.15.57:0/2801855034 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f177c00ae60 con 0x7f178c06adb0 2023-03-03T07:47:04.907 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:04.902+0000 7f1791926700 1 -- 172.21.15.57:0/2801855034 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f178c0913f0 con 0x7f178c06adb0 2023-03-03T07:47:04.907 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:04.902+0000 7f1791926700 1 -- 172.21.15.57:0/2801855034 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f178c091260 con 0x7f178c06adb0 2023-03-03T07:47:04.908 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:04.906+0000 7f1791926700 1 -- 172.21.15.57:0/2801855034 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f178c091580 con 0x7f178c06adb0 2023-03-03T07:47:04.909 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:04.906+0000 7f1773fff700 1 -- 172.21.15.57:0/2801855034 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 9) v1 ==== 42325+0+0 (secure 0 0 0) 0x7f177c019030 con 0x7f178c06adb0 2023-03-03T07:47:04.910 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:04.906+0000 7f1773fff700 1 --2- 172.21.15.57:0/2801855034 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f1778034910 0x7f1778036dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:04.910 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:04.906+0000 7f1773fff700 1 -- 172.21.15.57:0/2801855034 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 2928+0+0 (secure 0 0 0) 0x7f177c045f30 con 0x7f178c06adb0 2023-03-03T07:47:04.911 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:04.906+0000 7f178a7fc700 1 --2- 172.21.15.57:0/2801855034 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f1778034910 0x7f1778036dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:04.912 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:04.910+0000 7f178a7fc700 1 --2- 172.21.15.57:0/2801855034 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f1778034910 0x7f1778036dc0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f178000aa30 tx=0x7f1780012000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:04.917 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:04.914+0000 7f1773fff700 1 -- 172.21.15.57:0/2801855034 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f177c010af0 con 0x7f178c06adb0 2023-03-03T07:47:05.188 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:05.186+0000 7f1791926700 1 -- 172.21.15.57:0/2801855034 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f178c0619b0 con 0x7f178c06adb0 2023-03-03T07:47:05.189 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:05.186+0000 7f1773fff700 1 -- 172.21.15.57:0/2801855034 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f177c017030 con 0x7f178c06adb0 2023-03-03T07:47:05.377 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:05.374+0000 7f1791926700 1 -- 172.21.15.57:0/2801855034 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f178c0008d0 con 0x7f178c06adb0 2023-03-03T07:47:05.378 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:05.374+0000 7f1773fff700 1 -- 172.21.15.57:0/2801855034 <== mon.0 v2:172.21.15.57:3300/0 8 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f177c010af0 con 0x7f178c06adb0 2023-03-03T07:47:05.382 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:05.378+0000 7f1791926700 1 -- 172.21.15.57:0/2801855034 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f1778034910 msgr2=0x7f1778036dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:05.382 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:05.378+0000 7f1791926700 1 --2- 172.21.15.57:0/2801855034 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f1778034910 0x7f1778036dc0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f178000aa30 tx=0x7f1780012000 comp rx=0 tx=0).stop 2023-03-03T07:47:05.383 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:05.378+0000 7f1791926700 1 -- 172.21.15.57:0/2801855034 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f178c06adb0 msgr2=0x7f178c1c0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:05.383 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:05.378+0000 7f1791926700 1 --2- 172.21.15.57:0/2801855034 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f178c06adb0 0x7f178c1c0320 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f177c00cbd0 tx=0x7f177c00cf90 comp rx=0 tx=0).stop 2023-03-03T07:47:05.383 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:05.378+0000 7f1791926700 1 -- 172.21.15.57:0/2801855034 shutdown_connections 2023-03-03T07:47:05.384 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:05.378+0000 7f1791926700 1 --2- 172.21.15.57:0/2801855034 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f1778034910 0x7f1778036dc0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:05.384 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:05.378+0000 7f1791926700 1 --2- 172.21.15.57:0/2801855034 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f178c06adb0 0x7f178c1c0320 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:05.384 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:05.378+0000 7f1791926700 1 -- 172.21.15.57:0/2801855034 >> 172.21.15.57:0/2801855034 conn(0x7f178c0948d0 msgr2=0x7f178c121c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:47:05.384 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:05.378+0000 7f1791926700 1 -- 172.21.15.57:0/2801855034 shutdown_connections 2023-03-03T07:47:05.384 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:05.378+0000 7f1791926700 1 -- 172.21.15.57:0/2801855034 wait complete. 2023-03-03T07:47:05.413 INFO:tasks.workunit.client.0.smithi057.stderr:+ health=HEALTH_OK 2023-03-03T07:47:05.413 INFO:tasks.workunit.client.0.smithi057.stderr:+ [[ HEALTH_OK = *\O\S\D\_\F\U\L\L* ]] 2023-03-03T07:47:05.413 INFO:tasks.workunit.client.0.smithi057.stderr:+ echo 'Wating for osd to be full: 85' 2023-03-03T07:47:05.414 INFO:tasks.workunit.client.0.smithi057.stdout:Wating for osd to be full: 85 2023-03-03T07:47:05.414 INFO:tasks.workunit.client.0.smithi057.stderr:+ sleep 1 2023-03-03T07:47:06.417 INFO:tasks.workunit.client.0.smithi057.stderr:+ let timeout-=1 2023-03-03T07:47:06.417 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 84 -gt 0 ']' 2023-03-03T07:47:06.418 INFO:tasks.workunit.client.0.smithi057.stderr:++ ceph health detail 2023-03-03T07:47:06.590 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:06.586+0000 7f130308c700 1 Processor -- start 2023-03-03T07:47:06.591 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:06.586+0000 7f130308c700 1 -- start start 2023-03-03T07:47:06.592 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:06.590+0000 7f130308c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f12fc091a10 0x7f12fc08e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:06.592 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:06.590+0000 7f130308c700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12fc0911f0 con 0x7f12fc091de0 2023-03-03T07:47:06.592 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:06.590+0000 7f130308c700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12fc0662f0 con 0x7f12fc091a10 2023-03-03T07:47:06.592 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:06.590+0000 7f130208a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f12fc091a10 0x7f12fc08e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:06.593 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:06.590+0000 7f1301889700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f12fc091de0 0x7f12fc08ec70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56926/0 (socket says 172.21.15.57:56926) 2023-03-03T07:47:06.593 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:06.590+0000 7f1301889700 1 -- 172.21.15.57:0/733665406 learned_addr learned my addr 172.21.15.57:0/733665406 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:47:06.593 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:06.590+0000 7f130208a700 1 -- 172.21.15.57:0/733665406 >> v1:172.21.15.57:6789/0 conn(0x7f12fc091de0 legacy=0x7f12fc08ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:06.593 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:06.590+0000 7f130208a700 1 -- 172.21.15.57:0/733665406 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12fc066700 con 0x7f12fc091a10 2023-03-03T07:47:06.594 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:06.590+0000 7f130208a700 1 --2- 172.21.15.57:0/733665406 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12fc091a10 0x7f12fc08e730 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f12f80097d0 tx=0x7f12f8009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=967defb0f2114213 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:06.594 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:06.590+0000 7f1301088700 1 -- 172.21.15.57:0/733665406 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12f80041c0 con 0x7f12fc091a10 2023-03-03T07:47:06.594 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:06.590+0000 7f1301088700 1 -- 172.21.15.57:0/733665406 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f8004320 con 0x7f12fc091a10 2023-03-03T07:47:06.594 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:06.590+0000 7f1301088700 1 -- 172.21.15.57:0/733665406 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12f80036c0 con 0x7f12fc091a10 2023-03-03T07:47:06.595 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:06.590+0000 7f130308c700 1 -- 172.21.15.57:0/733665406 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12fc091a10 msgr2=0x7f12fc08e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:06.595 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:06.590+0000 7f130308c700 1 --2- 172.21.15.57:0/733665406 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12fc091a10 0x7f12fc08e730 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f12f80097d0 tx=0x7f12f8009ae0 comp rx=0 tx=0).stop 2023-03-03T07:47:06.596 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:06.594+0000 7f130308c700 1 -- 172.21.15.57:0/733665406 shutdown_connections 2023-03-03T07:47:06.596 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:06.594+0000 7f130308c700 1 --2- 172.21.15.57:0/733665406 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12fc091a10 0x7f12fc08e730 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:06.597 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:06.594+0000 7f130308c700 1 -- 172.21.15.57:0/733665406 >> 172.21.15.57:0/733665406 conn(0x7f12fc08a3c0 msgr2=0x7f12fc08c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:47:06.597 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:06.594+0000 7f130308c700 1 -- 172.21.15.57:0/733665406 shutdown_connections 2023-03-03T07:47:06.597 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:06.594+0000 7f130308c700 1 -- 172.21.15.57:0/733665406 wait complete. 2023-03-03T07:47:06.599 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:06.598+0000 7f130308c700 1 Processor -- start 2023-03-03T07:47:06.600 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:06.598+0000 7f130308c700 1 -- start start 2023-03-03T07:47:06.601 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:06.598+0000 7f130308c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12fc091a10 0x7f12fc125db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:06.601 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:06.598+0000 7f130308c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12fc128820 con 0x7f12fc091a10 2023-03-03T07:47:06.602 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:06.598+0000 7f130208a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12fc091a10 0x7f12fc125db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:06.602 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:06.598+0000 7f130208a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12fc091a10 0x7f12fc125db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59536/0 (socket says 172.21.15.57:59536) 2023-03-03T07:47:06.602 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:06.598+0000 7f130208a700 1 -- 172.21.15.57:0/3663506716 learned_addr learned my addr 172.21.15.57:0/3663506716 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:47:06.603 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:06.598+0000 7f130208a700 1 -- 172.21.15.57:0/3663506716 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f80094b0 con 0x7f12fc091a10 2023-03-03T07:47:06.603 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:06.598+0000 7f130208a700 1 --2- 172.21.15.57:0/3663506716 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12fc091a10 0x7f12fc125db0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f12f80090b0 tx=0x7f12f8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:06.603 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:06.598+0000 7f12f2ffd700 1 -- 172.21.15.57:0/3663506716 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12f8006ea0 con 0x7f12fc091a10 2023-03-03T07:47:06.604 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:06.602+0000 7f12f2ffd700 1 -- 172.21.15.57:0/3663506716 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f8003e10 con 0x7f12fc091a10 2023-03-03T07:47:06.604 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:06.602+0000 7f12f2ffd700 1 -- 172.21.15.57:0/3663506716 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12f80119b0 con 0x7f12fc091a10 2023-03-03T07:47:06.604 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:06.602+0000 7f130308c700 1 -- 172.21.15.57:0/3663506716 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12fc090f00 con 0x7f12fc091a10 2023-03-03T07:47:06.604 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:06.602+0000 7f130308c700 1 -- 172.21.15.57:0/3663506716 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12fc08f590 con 0x7f12fc091a10 2023-03-03T07:47:06.605 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:06.602+0000 7f12f2ffd700 1 -- 172.21.15.57:0/3663506716 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 9) v1 ==== 42325+0+0 (secure 0 0 0) 0x7f12f802d070 con 0x7f12fc091a10 2023-03-03T07:47:06.605 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:06.602+0000 7f130308c700 1 -- 172.21.15.57:0/3663506716 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12fc12d720 con 0x7f12fc091a10 2023-03-03T07:47:06.606 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:06.602+0000 7f12f2ffd700 1 --2- 172.21.15.57:0/3663506716 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f12e0034910 0x7f12e0036dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:06.606 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:06.602+0000 7f12f2ffd700 1 -- 172.21.15.57:0/3663506716 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 2928+0+0 (secure 0 0 0) 0x7f12f8047260 con 0x7f12fc091a10 2023-03-03T07:47:06.606 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:06.602+0000 7f1301889700 1 --2- 172.21.15.57:0/3663506716 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f12e0034910 0x7f12e0036dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:06.608 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:06.606+0000 7f1301889700 1 --2- 172.21.15.57:0/3663506716 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f12e0034910 0x7f12e0036dc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f12fc092210 tx=0x7f12ec007b70 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:06.613 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:06.610+0000 7f12f2ffd700 1 -- 172.21.15.57:0/3663506716 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f12f80259a0 con 0x7f12fc091a10 2023-03-03T07:47:06.853 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:06.850+0000 7f130308c700 1 -- 172.21.15.57:0/3663506716 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f12fc128ba0 con 0x7f12fc091a10 2023-03-03T07:47:06.854 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:06.850+0000 7f12f2ffd700 1 -- 172.21.15.57:0/3663506716 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f12f8016020 con 0x7f12fc091a10 2023-03-03T07:47:07.033 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:07.030+0000 7f130308c700 1 -- 172.21.15.57:0/3663506716 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f12fc128450 con 0x7f12fc091a10 2023-03-03T07:47:07.034 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:07.030+0000 7f12f2ffd700 1 -- 172.21.15.57:0/3663506716 <== mon.0 v2:172.21.15.57:3300/0 8 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f12f8016020 con 0x7f12fc091a10 2023-03-03T07:47:07.036 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:07.034+0000 7f130308c700 1 -- 172.21.15.57:0/3663506716 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f12e0034910 msgr2=0x7f12e0036dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:07.037 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:07.034+0000 7f130308c700 1 --2- 172.21.15.57:0/3663506716 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f12e0034910 0x7f12e0036dc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f12fc092210 tx=0x7f12ec007b70 comp rx=0 tx=0).stop 2023-03-03T07:47:07.037 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:07.034+0000 7f130308c700 1 -- 172.21.15.57:0/3663506716 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12fc091a10 msgr2=0x7f12fc125db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:07.037 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:07.034+0000 7f130308c700 1 --2- 172.21.15.57:0/3663506716 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12fc091a10 0x7f12fc125db0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f12f80090b0 tx=0x7f12f8004770 comp rx=0 tx=0).stop 2023-03-03T07:47:07.038 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:07.034+0000 7f130308c700 1 -- 172.21.15.57:0/3663506716 shutdown_connections 2023-03-03T07:47:07.038 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:07.034+0000 7f130308c700 1 --2- 172.21.15.57:0/3663506716 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f12e0034910 0x7f12e0036dc0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:07.038 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:07.034+0000 7f130308c700 1 --2- 172.21.15.57:0/3663506716 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12fc091a10 0x7f12fc125db0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:07.038 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:07.034+0000 7f130308c700 1 -- 172.21.15.57:0/3663506716 >> 172.21.15.57:0/3663506716 conn(0x7f12fc08a3c0 msgr2=0x7f12fc12cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:47:07.038 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:07.034+0000 7f130308c700 1 -- 172.21.15.57:0/3663506716 shutdown_connections 2023-03-03T07:47:07.038 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:07.034+0000 7f130308c700 1 -- 172.21.15.57:0/3663506716 wait complete. 2023-03-03T07:47:07.063 INFO:tasks.workunit.client.0.smithi057.stdout:Wating for osd to be full: 84 2023-03-03T07:47:07.063 INFO:tasks.workunit.client.0.smithi057.stderr:+ health=HEALTH_OK 2023-03-03T07:47:07.063 INFO:tasks.workunit.client.0.smithi057.stderr:+ [[ HEALTH_OK = *\O\S\D\_\F\U\L\L* ]] 2023-03-03T07:47:07.064 INFO:tasks.workunit.client.0.smithi057.stderr:+ echo 'Wating for osd to be full: 84' 2023-03-03T07:47:07.064 INFO:tasks.workunit.client.0.smithi057.stderr:+ sleep 1 2023-03-03T07:47:08.069 INFO:tasks.workunit.client.0.smithi057.stderr:+ let timeout-=1 2023-03-03T07:47:08.070 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 83 -gt 0 ']' 2023-03-03T07:47:08.072 INFO:tasks.workunit.client.0.smithi057.stderr:++ ceph health detail 2023-03-03T07:47:08.242 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:08.238+0000 7f60dd710700 1 Processor -- start 2023-03-03T07:47:08.242 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:08.238+0000 7f60dd710700 1 -- start start 2023-03-03T07:47:08.243 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:08.238+0000 7f60dd710700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f60d8128650 0x7f60d812aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:08.243 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:08.242+0000 7f60dd710700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60d808f570 con 0x7f60d81235b0 2023-03-03T07:47:08.244 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:08.242+0000 7f60dd710700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60d808f7a0 con 0x7f60d8128650 2023-03-03T07:47:08.244 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:08.242+0000 7f60d7fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f60d81235b0 0x7f60d8123980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56942/0 (socket says 172.21.15.57:56942) 2023-03-03T07:47:08.244 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:08.242+0000 7f60d7fff700 1 -- 172.21.15.57:0/2902428671 learned_addr learned my addr 172.21.15.57:0/2902428671 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:47:08.244 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:08.242+0000 7f60d77fe700 1 --2- 172.21.15.57:0/2902428671 >> v2:172.21.15.57:3300/0 conn(0x7f60d8128650 0x7f60d812aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:08.245 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:08.242+0000 7f60d6ffd700 1 -- 172.21.15.57:0/2902428671 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 877633414 0 0) 0x7f60d808f570 con 0x7f60d81235b0 2023-03-03T07:47:08.245 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:08.242+0000 7f60d6ffd700 1 -- 172.21.15.57:0/2902428671 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60c00035d0 con 0x7f60d81235b0 2023-03-03T07:47:08.245 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:08.242+0000 7f60d77fe700 1 -- 172.21.15.57:0/2902428671 >> v1:172.21.15.57:6789/0 conn(0x7f60d81235b0 legacy=0x7f60d8123980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:08.245 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:08.242+0000 7f60d77fe700 1 -- 172.21.15.57:0/2902428671 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d808fab0 con 0x7f60d8128650 2023-03-03T07:47:08.246 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:08.242+0000 7f60d77fe700 1 --2- 172.21.15.57:0/2902428671 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60d8128650 0x7f60d812aa30 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f60cc009d90 tx=0x7f60cc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3d64f4fe68c46e8 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:08.246 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:08.242+0000 7f60d6ffd700 1 -- 172.21.15.57:0/2902428671 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f60cc00e070 con 0x7f60d8128650 2023-03-03T07:47:08.246 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:08.242+0000 7f60d6ffd700 1 -- 172.21.15.57:0/2902428671 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60cc00bbd0 con 0x7f60d8128650 2023-03-03T07:47:08.246 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:08.242+0000 7f60d6ffd700 1 -- 172.21.15.57:0/2902428671 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f60cc003a40 con 0x7f60d8128650 2023-03-03T07:47:08.247 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:08.242+0000 7f60dd710700 1 -- 172.21.15.57:0/2902428671 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60d8128650 msgr2=0x7f60d812aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:08.247 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:08.242+0000 7f60dd710700 1 --2- 172.21.15.57:0/2902428671 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60d8128650 0x7f60d812aa30 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f60cc009d90 tx=0x7f60cc00b330 comp rx=0 tx=0).stop 2023-03-03T07:47:08.248 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:08.246+0000 7f60dd710700 1 -- 172.21.15.57:0/2902428671 shutdown_connections 2023-03-03T07:47:08.248 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:08.246+0000 7f60dd710700 1 --2- 172.21.15.57:0/2902428671 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60d8128650 0x7f60d812aa30 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:08.248 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:08.246+0000 7f60dd710700 1 -- 172.21.15.57:0/2902428671 >> 172.21.15.57:0/2902428671 conn(0x7f60d80943e0 msgr2=0x7f60d8095e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:47:08.248 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:08.246+0000 7f60dd710700 1 -- 172.21.15.57:0/2902428671 shutdown_connections 2023-03-03T07:47:08.248 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:08.246+0000 7f60dd710700 1 -- 172.21.15.57:0/2902428671 wait complete. 2023-03-03T07:47:08.250 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:08.246+0000 7f60dd710700 1 Processor -- start 2023-03-03T07:47:08.250 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:08.246+0000 7f60dd710700 1 -- start start 2023-03-03T07:47:08.251 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:08.250+0000 7f60dd710700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60d81235b0 0x7f60d81c0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:08.251 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:08.250+0000 7f60dd710700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d811f1a0 con 0x7f60d81235b0 2023-03-03T07:47:08.252 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:08.250+0000 7f60d7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60d81235b0 0x7f60d81c0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:08.252 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:08.250+0000 7f60d7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60d81235b0 0x7f60d81c0220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59558/0 (socket says 172.21.15.57:59558) 2023-03-03T07:47:08.252 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:08.250+0000 7f60d7fff700 1 -- 172.21.15.57:0/3886558518 learned_addr learned my addr 172.21.15.57:0/3886558518 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:47:08.253 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:08.250+0000 7f60d7fff700 1 -- 172.21.15.57:0/3886558518 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60cc009a70 con 0x7f60d81235b0 2023-03-03T07:47:08.253 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:08.250+0000 7f60d7fff700 1 --2- 172.21.15.57:0/3886558518 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60d81235b0 0x7f60d81c0220 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f60c800c680 tx=0x7f60c800ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:08.254 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:08.250+0000 7f60d4ff9700 1 -- 172.21.15.57:0/3886558518 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f60c8005cc0 con 0x7f60d81235b0 2023-03-03T07:47:08.254 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:08.250+0000 7f60d4ff9700 1 -- 172.21.15.57:0/3886558518 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c8005e20 con 0x7f60d81235b0 2023-03-03T07:47:08.254 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:08.250+0000 7f60dd710700 1 -- 172.21.15.57:0/3886558518 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60d812b310 con 0x7f60d81235b0 2023-03-03T07:47:08.254 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:08.250+0000 7f60d4ff9700 1 -- 172.21.15.57:0/3886558518 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f60c8007220 con 0x7f60d81235b0 2023-03-03T07:47:08.255 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:08.250+0000 7f60dd710700 1 -- 172.21.15.57:0/3886558518 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60d812b180 con 0x7f60d81235b0 2023-03-03T07:47:08.256 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:08.254+0000 7f60dd710700 1 -- 172.21.15.57:0/3886558518 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60d812b4a0 con 0x7f60d81235b0 2023-03-03T07:47:08.256 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:08.254+0000 7f60d4ff9700 1 -- 172.21.15.57:0/3886558518 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 9) v1 ==== 42325+0+0 (secure 0 0 0) 0x7f60c8019030 con 0x7f60d81235b0 2023-03-03T07:47:08.258 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:08.254+0000 7f60d4ff9700 1 --2- 172.21.15.57:0/3886558518 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f60c4034910 0x7f60c4036dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:08.258 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:08.254+0000 7f60d4ff9700 1 -- 172.21.15.57:0/3886558518 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 2928+0+0 (secure 0 0 0) 0x7f60c8045730 con 0x7f60d81235b0 2023-03-03T07:47:08.259 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:08.254+0000 7f60d77fe700 1 --2- 172.21.15.57:0/3886558518 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f60c4034910 0x7f60c4036dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:08.259 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:08.258+0000 7f60d77fe700 1 --2- 172.21.15.57:0/3886558518 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f60c4034910 0x7f60c4036dc0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f60d808f0c0 tx=0x7f60cc011000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:08.265 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:08.262+0000 7f60d4ff9700 1 -- 172.21.15.57:0/3886558518 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f60c80196b0 con 0x7f60d81235b0 2023-03-03T07:47:08.506 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:08.502+0000 7f60dd710700 1 -- 172.21.15.57:0/3886558518 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f60d80619b0 con 0x7f60d81235b0 2023-03-03T07:47:08.507 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:08.502+0000 7f60d4ff9700 1 -- 172.21.15.57:0/3886558518 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+280 (secure 0 0 0) 0x7f60c8017070 con 0x7f60d81235b0 2023-03-03T07:47:08.661 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:08.658+0000 7f60dd710700 1 -- 172.21.15.57:0/3886558518 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f60d8072140 con 0x7f60d81235b0 2023-03-03T07:47:08.661 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:08.658+0000 7f60d4ff9700 1 -- 172.21.15.57:0/3886558518 <== mon.0 v2:172.21.15.57:3300/0 8 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+280 (secure 0 0 0) 0x7f60c80192c0 con 0x7f60d81235b0 2023-03-03T07:47:08.664 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:08.662+0000 7f60dd710700 1 -- 172.21.15.57:0/3886558518 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f60c4034910 msgr2=0x7f60c4036dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:08.665 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:08.662+0000 7f60dd710700 1 --2- 172.21.15.57:0/3886558518 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f60c4034910 0x7f60c4036dc0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f60d808f0c0 tx=0x7f60cc011000 comp rx=0 tx=0).stop 2023-03-03T07:47:08.665 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:08.662+0000 7f60dd710700 1 -- 172.21.15.57:0/3886558518 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60d81235b0 msgr2=0x7f60d81c0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:08.665 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:08.662+0000 7f60dd710700 1 --2- 172.21.15.57:0/3886558518 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60d81235b0 0x7f60d81c0220 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f60c800c680 tx=0x7f60c800ca40 comp rx=0 tx=0).stop 2023-03-03T07:47:08.665 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:08.662+0000 7f60dd710700 1 -- 172.21.15.57:0/3886558518 shutdown_connections 2023-03-03T07:47:08.665 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:08.662+0000 7f60dd710700 1 --2- 172.21.15.57:0/3886558518 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f60c4034910 0x7f60c4036dc0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:08.665 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:08.662+0000 7f60dd710700 1 --2- 172.21.15.57:0/3886558518 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60d81235b0 0x7f60d81c0220 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:08.665 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:08.662+0000 7f60dd710700 1 -- 172.21.15.57:0/3886558518 >> 172.21.15.57:0/3886558518 conn(0x7f60d80943e0 msgr2=0x7f60d8124590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:47:08.666 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:08.662+0000 7f60dd710700 1 -- 172.21.15.57:0/3886558518 shutdown_connections 2023-03-03T07:47:08.666 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:08.662+0000 7f60dd710700 1 -- 172.21.15.57:0/3886558518 wait complete. 2023-03-03T07:47:08.694 INFO:tasks.workunit.client.0.smithi057.stderr:+ health='HEALTH_WARN 1 nearfull osd(s); 4 pool(s) nearfull 2023-03-03T07:47:08.694 INFO:tasks.workunit.client.0.smithi057.stderr:[WRN] OSD_NEARFULL: 1 nearfull osd(s) 2023-03-03T07:47:08.694 INFO:tasks.workunit.client.0.smithi057.stderr: osd.0 is near full 2023-03-03T07:47:08.694 INFO:tasks.workunit.client.0.smithi057.stderr:[WRN] POOL_NEARFULL: 4 pool(s) nearfull 2023-03-03T07:47:08.694 INFO:tasks.workunit.client.0.smithi057.stderr: pool '\''.mgr'\'' is nearfull 2023-03-03T07:47:08.695 INFO:tasks.workunit.client.0.smithi057.stderr: pool '\''rbd'\'' is nearfull 2023-03-03T07:47:08.695 INFO:tasks.workunit.client.0.smithi057.stderr: pool '\''cephfs_metadata'\'' is nearfull 2023-03-03T07:47:08.695 INFO:tasks.workunit.client.0.smithi057.stderr: pool '\''cephfs_data'\'' is nearfull' 2023-03-03T07:47:08.695 INFO:tasks.workunit.client.0.smithi057.stderr:+ [[ HEALTH_WARN 1 nearfull osd(s); 4 pool(s) nearfull 2023-03-03T07:47:08.695 INFO:tasks.workunit.client.0.smithi057.stderr:[WRN] OSD_NEARFULL: 1 nearfull osd(s) 2023-03-03T07:47:08.695 INFO:tasks.workunit.client.0.smithi057.stderr: osd.0 is near full 2023-03-03T07:47:08.695 INFO:tasks.workunit.client.0.smithi057.stderr:[WRN] POOL_NEARFULL: 4 pool(s) nearfull 2023-03-03T07:47:08.695 INFO:tasks.workunit.client.0.smithi057.stderr: pool '.mgr' is nearfull 2023-03-03T07:47:08.696 INFO:tasks.workunit.client.0.smithi057.stderr: pool 'rbd' is nearfull 2023-03-03T07:47:08.696 INFO:tasks.workunit.client.0.smithi057.stderr: pool 'cephfs_metadata' is nearfull 2023-03-03T07:47:08.696 INFO:tasks.workunit.client.0.smithi057.stderr: pool 'cephfs_data' is nearfull = *\O\S\D\_\F\U\L\L* ]] 2023-03-03T07:47:08.696 INFO:tasks.workunit.client.0.smithi057.stdout:Wating for osd to be full: 83 2023-03-03T07:47:08.696 INFO:tasks.workunit.client.0.smithi057.stderr:+ echo 'Wating for osd to be full: 83' 2023-03-03T07:47:08.697 INFO:tasks.workunit.client.0.smithi057.stderr:+ sleep 1 2023-03-03T07:47:09.701 INFO:tasks.workunit.client.0.smithi057.stderr:+ let timeout-=1 2023-03-03T07:47:09.701 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 82 -gt 0 ']' 2023-03-03T07:47:09.703 INFO:tasks.workunit.client.0.smithi057.stderr:++ ceph health detail 2023-03-03T07:47:09.872 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:09.869+0000 7f6db69e6700 1 Processor -- start 2023-03-03T07:47:09.872 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:09.869+0000 7f6db69e6700 1 -- start start 2023-03-03T07:47:09.874 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:09.869+0000 7f6db69e6700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6db0125870 0x7f6db0125c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:09.874 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:09.869+0000 7f6db69e6700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6db0070380 con 0x7f6db006e1b0 2023-03-03T07:47:09.874 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:09.869+0000 7f6db69e6700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6db0070690 con 0x7f6db0125870 2023-03-03T07:47:09.875 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:09.869+0000 7f6db59e4700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6db0125870 0x7f6db0125c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:09.875 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:09.869+0000 7f6db51e3700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f6db006e1b0 0x7f6db006e630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57144/0 (socket says 172.21.15.57:57144) 2023-03-03T07:47:09.875 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:09.869+0000 7f6db51e3700 1 -- 172.21.15.57:0/1659164242 learned_addr learned my addr 172.21.15.57:0/1659164242 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:47:09.875 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:09.873+0000 7f6db49e2700 1 -- 172.21.15.57:0/1659164242 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2365534413 0 0) 0x7f6db0070380 con 0x7f6db006e1b0 2023-03-03T07:47:09.876 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:09.873+0000 7f6db59e4700 1 -- 172.21.15.57:0/1659164242 >> v1:172.21.15.57:6789/0 conn(0x7f6db006e1b0 legacy=0x7f6db006e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:09.876 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:09.873+0000 7f6db59e4700 1 -- 172.21.15.57:0/1659164242 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db0126180 con 0x7f6db0125870 2023-03-03T07:47:09.876 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:09.873+0000 7f6db59e4700 1 --2- 172.21.15.57:0/1659164242 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6db0125870 0x7f6db0125c40 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6dac0097d0 tx=0x7f6dac009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f015f0a92081d441 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:09.877 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:09.873+0000 7f6db49e2700 1 -- 172.21.15.57:0/1659164242 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6dac0041c0 con 0x7f6db0125870 2023-03-03T07:47:09.877 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:09.873+0000 7f6db49e2700 1 -- 172.21.15.57:0/1659164242 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dac004320 con 0x7f6db0125870 2023-03-03T07:47:09.877 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:09.873+0000 7f6db49e2700 1 -- 172.21.15.57:0/1659164242 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6dac0036c0 con 0x7f6db0125870 2023-03-03T07:47:09.878 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:09.873+0000 7f6db69e6700 1 -- 172.21.15.57:0/1659164242 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6db0125870 msgr2=0x7f6db0125c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:09.878 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:09.873+0000 7f6db69e6700 1 --2- 172.21.15.57:0/1659164242 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6db0125870 0x7f6db0125c40 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6dac0097d0 tx=0x7f6dac009ae0 comp rx=0 tx=0).stop 2023-03-03T07:47:09.878 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:09.873+0000 7f6db69e6700 1 -- 172.21.15.57:0/1659164242 shutdown_connections 2023-03-03T07:47:09.879 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:09.873+0000 7f6db69e6700 1 --2- 172.21.15.57:0/1659164242 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6db0125870 0x7f6db0125c40 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:09.879 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:09.873+0000 7f6db69e6700 1 -- 172.21.15.57:0/1659164242 >> 172.21.15.57:0/1659164242 conn(0x7f6db00943e0 msgr2=0x7f6db0095e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:47:09.879 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:09.877+0000 7f6db69e6700 1 -- 172.21.15.57:0/1659164242 shutdown_connections 2023-03-03T07:47:09.880 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:09.877+0000 7f6db69e6700 1 -- 172.21.15.57:0/1659164242 wait complete. 2023-03-03T07:47:09.881 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:09.877+0000 7f6db69e6700 1 Processor -- start 2023-03-03T07:47:09.882 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:09.877+0000 7f6db69e6700 1 -- start start 2023-03-03T07:47:09.883 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:09.877+0000 7f6db69e6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6db006e1b0 0x7f6db01bc430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:09.883 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:09.877+0000 7f6db69e6700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db01bbdd0 con 0x7f6db006e1b0 2023-03-03T07:47:09.883 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:09.881+0000 7f6db59e4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6db006e1b0 0x7f6db01bc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:09.883 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:09.881+0000 7f6db59e4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6db006e1b0 0x7f6db01bc430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33362/0 (socket says 172.21.15.57:33362) 2023-03-03T07:47:09.884 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:09.881+0000 7f6db59e4700 1 -- 172.21.15.57:0/2924122891 learned_addr learned my addr 172.21.15.57:0/2924122891 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:47:09.884 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:09.881+0000 7f6db59e4700 1 -- 172.21.15.57:0/2924122891 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dac0094b0 con 0x7f6db006e1b0 2023-03-03T07:47:09.884 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:09.881+0000 7f6db59e4700 1 --2- 172.21.15.57:0/2924122891 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6db006e1b0 0x7f6db01bc430 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6dac0090b0 tx=0x7f6dac004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:09.885 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:09.881+0000 7f6da67fc700 1 -- 172.21.15.57:0/2924122891 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6dac006ea0 con 0x7f6db006e1b0 2023-03-03T07:47:09.885 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:09.881+0000 7f6da67fc700 1 -- 172.21.15.57:0/2924122891 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dac011760 con 0x7f6db006e1b0 2023-03-03T07:47:09.885 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:09.881+0000 7f6da67fc700 1 -- 172.21.15.57:0/2924122891 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6dac011a20 con 0x7f6db006e1b0 2023-03-03T07:47:09.886 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:09.881+0000 7f6db69e6700 1 -- 172.21.15.57:0/2924122891 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6db012d880 con 0x7f6db006e1b0 2023-03-03T07:47:09.886 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:09.881+0000 7f6db69e6700 1 -- 172.21.15.57:0/2924122891 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6db006ef50 con 0x7f6db006e1b0 2023-03-03T07:47:09.887 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:09.885+0000 7f6da67fc700 1 -- 172.21.15.57:0/2924122891 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 9) v1 ==== 42325+0+0 (secure 0 0 0) 0x7f6dac02d070 con 0x7f6db006e1b0 2023-03-03T07:47:09.888 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:09.885+0000 7f6db69e6700 1 -- 172.21.15.57:0/2924122891 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6db012da10 con 0x7f6db006e1b0 2023-03-03T07:47:09.888 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:09.885+0000 7f6da67fc700 1 --2- 172.21.15.57:0/2924122891 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f6d94034910 0x7f6d94036dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:09.888 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:09.885+0000 7f6da67fc700 1 -- 172.21.15.57:0/2924122891 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 2928+0+0 (secure 0 0 0) 0x7f6dac047280 con 0x7f6db006e1b0 2023-03-03T07:47:09.889 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:09.885+0000 7f6db51e3700 1 --2- 172.21.15.57:0/2924122891 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f6d94034910 0x7f6d94036dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:09.890 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:09.885+0000 7f6db51e3700 1 --2- 172.21.15.57:0/2924122891 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f6d94034910 0x7f6d94036dc0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6da0000c00 tx=0x7f6da00079c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:09.895 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:09.889+0000 7f6da67fc700 1 -- 172.21.15.57:0/2924122891 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6dac024950 con 0x7f6db006e1b0 2023-03-03T07:47:10.136 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:10.133+0000 7f6db69e6700 1 -- 172.21.15.57:0/2924122891 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f6db00619b0 con 0x7f6db006e1b0 2023-03-03T07:47:10.136 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:10.133+0000 7f6da67fc700 1 -- 172.21.15.57:0/2924122891 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+280 (secure 0 0 0) 0x7f6dac016020 con 0x7f6db006e1b0 2023-03-03T07:47:10.299 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:10.293+0000 7f6db69e6700 1 -- 172.21.15.57:0/2924122891 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f6db0090420 con 0x7f6db006e1b0 2023-03-03T07:47:10.299 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:10.297+0000 7f6da67fc700 1 -- 172.21.15.57:0/2924122891 <== mon.0 v2:172.21.15.57:3300/0 8 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+280 (secure 0 0 0) 0x7f6dac016020 con 0x7f6db006e1b0 2023-03-03T07:47:10.302 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:10.297+0000 7f6db69e6700 1 -- 172.21.15.57:0/2924122891 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f6d94034910 msgr2=0x7f6d94036dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:10.302 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:10.297+0000 7f6db69e6700 1 --2- 172.21.15.57:0/2924122891 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f6d94034910 0x7f6d94036dc0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6da0000c00 tx=0x7f6da00079c0 comp rx=0 tx=0).stop 2023-03-03T07:47:10.303 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:10.297+0000 7f6db69e6700 1 -- 172.21.15.57:0/2924122891 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6db006e1b0 msgr2=0x7f6db01bc430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:10.303 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:10.297+0000 7f6db69e6700 1 --2- 172.21.15.57:0/2924122891 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6db006e1b0 0x7f6db01bc430 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6dac0090b0 tx=0x7f6dac004770 comp rx=0 tx=0).stop 2023-03-03T07:47:10.303 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:10.297+0000 7f6db69e6700 1 -- 172.21.15.57:0/2924122891 shutdown_connections 2023-03-03T07:47:10.304 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:10.297+0000 7f6db69e6700 1 --2- 172.21.15.57:0/2924122891 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f6d94034910 0x7f6d94036dc0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:10.304 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:10.297+0000 7f6db69e6700 1 --2- 172.21.15.57:0/2924122891 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6db006e1b0 0x7f6db01bc430 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:10.304 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:10.297+0000 7f6db69e6700 1 -- 172.21.15.57:0/2924122891 >> 172.21.15.57:0/2924122891 conn(0x7f6db00943e0 msgr2=0x7f6db0090c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:47:10.304 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:10.297+0000 7f6db69e6700 1 -- 172.21.15.57:0/2924122891 shutdown_connections 2023-03-03T07:47:10.304 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:10.301+0000 7f6db69e6700 1 -- 172.21.15.57:0/2924122891 wait complete. 2023-03-03T07:47:10.329 INFO:tasks.workunit.client.0.smithi057.stderr:+ health='HEALTH_WARN 1 nearfull osd(s); 4 pool(s) nearfull 2023-03-03T07:47:10.329 INFO:tasks.workunit.client.0.smithi057.stderr:[WRN] OSD_NEARFULL: 1 nearfull osd(s) 2023-03-03T07:47:10.330 INFO:tasks.workunit.client.0.smithi057.stderr: osd.0 is near full 2023-03-03T07:47:10.330 INFO:tasks.workunit.client.0.smithi057.stderr:[WRN] POOL_NEARFULL: 4 pool(s) nearfull 2023-03-03T07:47:10.330 INFO:tasks.workunit.client.0.smithi057.stderr: pool '\''.mgr'\'' is nearfull 2023-03-03T07:47:10.330 INFO:tasks.workunit.client.0.smithi057.stderr: pool '\''rbd'\'' is nearfull 2023-03-03T07:47:10.330 INFO:tasks.workunit.client.0.smithi057.stderr: pool '\''cephfs_metadata'\'' is nearfull 2023-03-03T07:47:10.330 INFO:tasks.workunit.client.0.smithi057.stderr: pool '\''cephfs_data'\'' is nearfull' 2023-03-03T07:47:10.330 INFO:tasks.workunit.client.0.smithi057.stderr:+ [[ HEALTH_WARN 1 nearfull osd(s); 4 pool(s) nearfull 2023-03-03T07:47:10.330 INFO:tasks.workunit.client.0.smithi057.stderr:[WRN] OSD_NEARFULL: 1 nearfull osd(s) 2023-03-03T07:47:10.331 INFO:tasks.workunit.client.0.smithi057.stderr: osd.0 is near full 2023-03-03T07:47:10.331 INFO:tasks.workunit.client.0.smithi057.stderr:[WRN] POOL_NEARFULL: 4 pool(s) nearfull 2023-03-03T07:47:10.331 INFO:tasks.workunit.client.0.smithi057.stderr: pool '.mgr' is nearfull 2023-03-03T07:47:10.331 INFO:tasks.workunit.client.0.smithi057.stderr: pool 'rbd' is nearfull 2023-03-03T07:47:10.331 INFO:tasks.workunit.client.0.smithi057.stderr: pool 'cephfs_metadata' is nearfull 2023-03-03T07:47:10.331 INFO:tasks.workunit.client.0.smithi057.stderr: pool 'cephfs_data' is nearfull = *\O\S\D\_\F\U\L\L* ]] 2023-03-03T07:47:10.331 INFO:tasks.workunit.client.0.smithi057.stderr:+ echo 'Wating for osd to be full: 82' 2023-03-03T07:47:10.331 INFO:tasks.workunit.client.0.smithi057.stderr:+ sleep 1 2023-03-03T07:47:10.332 INFO:tasks.workunit.client.0.smithi057.stdout:Wating for osd to be full: 82 2023-03-03T07:47:11.336 INFO:tasks.workunit.client.0.smithi057.stderr:+ let timeout-=1 2023-03-03T07:47:11.336 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 81 -gt 0 ']' 2023-03-03T07:47:11.339 INFO:tasks.workunit.client.0.smithi057.stderr:++ ceph health detail 2023-03-03T07:47:11.502 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:11.497+0000 7f506d6b8700 1 Processor -- start 2023-03-03T07:47:11.503 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:11.497+0000 7f506d6b8700 1 -- start start 2023-03-03T07:47:11.504 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:11.501+0000 7f506d6b8700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f506812a860 0x7f506812cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:11.504 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:11.501+0000 7f506d6b8700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50681253c0 con 0x7f5068125870 2023-03-03T07:47:11.504 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:11.501+0000 7f506d6b8700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5068070380 con 0x7f506812a860 2023-03-03T07:47:11.505 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:11.501+0000 7f5067fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f5068125870 0x7f5068125c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57158/0 (socket says 172.21.15.57:57158) 2023-03-03T07:47:11.505 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:11.501+0000 7f5067fff700 1 -- 172.21.15.57:0/3795596241 learned_addr learned my addr 172.21.15.57:0/3795596241 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:47:11.505 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:11.501+0000 7f505f7fe700 1 --2- 172.21.15.57:0/3795596241 >> v2:172.21.15.57:3300/0 conn(0x7f506812a860 0x7f506812cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:11.506 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:11.501+0000 7f50677fe700 1 -- 172.21.15.57:0/3795596241 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3393298487 0 0) 0x7f50681253c0 con 0x7f5068125870 2023-03-03T07:47:11.506 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:11.501+0000 7f50677fe700 1 -- 172.21.15.57:0/3795596241 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50480035d0 con 0x7f5068125870 2023-03-03T07:47:11.506 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:11.501+0000 7f505f7fe700 1 -- 172.21.15.57:0/3795596241 >> v1:172.21.15.57:6789/0 conn(0x7f5068125870 legacy=0x7f5068125c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:11.506 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:11.501+0000 7f505f7fe700 1 -- 172.21.15.57:0/3795596241 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5068070690 con 0x7f506812a860 2023-03-03T07:47:11.507 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:11.505+0000 7f505f7fe700 1 --2- 172.21.15.57:0/3795596241 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f506812a860 0x7f506812cc40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f50500097d0 tx=0x7f5050009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a91924c63f18ade0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:11.508 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:11.505+0000 7f50677fe700 1 -- 172.21.15.57:0/3795596241 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5050004160 con 0x7f506812a860 2023-03-03T07:47:11.508 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:11.505+0000 7f50677fe700 1 -- 172.21.15.57:0/3795596241 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50500042c0 con 0x7f506812a860 2023-03-03T07:47:11.508 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:11.505+0000 7f50677fe700 1 -- 172.21.15.57:0/3795596241 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50500045a0 con 0x7f506812a860 2023-03-03T07:47:11.509 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:11.505+0000 7f506d6b8700 1 -- 172.21.15.57:0/3795596241 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f506812a860 msgr2=0x7f506812cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:11.509 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:11.505+0000 7f506d6b8700 1 --2- 172.21.15.57:0/3795596241 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f506812a860 0x7f506812cc40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f50500097d0 tx=0x7f5050009ae0 comp rx=0 tx=0).stop 2023-03-03T07:47:11.509 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:11.505+0000 7f506d6b8700 1 -- 172.21.15.57:0/3795596241 shutdown_connections 2023-03-03T07:47:11.510 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:11.505+0000 7f506d6b8700 1 --2- 172.21.15.57:0/3795596241 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f506812a860 0x7f506812cc40 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:11.510 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:11.505+0000 7f506d6b8700 1 -- 172.21.15.57:0/3795596241 >> 172.21.15.57:0/3795596241 conn(0x7f50680943e0 msgr2=0x7f5068095e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:47:11.510 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:11.505+0000 7f506d6b8700 1 -- 172.21.15.57:0/3795596241 shutdown_connections 2023-03-03T07:47:11.510 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:11.505+0000 7f506d6b8700 1 -- 172.21.15.57:0/3795596241 wait complete. 2023-03-03T07:47:11.512 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:11.509+0000 7f506d6b8700 1 Processor -- start 2023-03-03T07:47:11.512 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:11.509+0000 7f506d6b8700 1 -- start start 2023-03-03T07:47:11.514 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:11.509+0000 7f506d6b8700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5068125870 0x7f50681bbf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:11.514 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:11.509+0000 7f506d6b8700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f506811ba80 con 0x7f5068125870 2023-03-03T07:47:11.514 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:11.509+0000 7f5067fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5068125870 0x7f50681bbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:11.514 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:11.509+0000 7f5067fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5068125870 0x7f50681bbf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33374/0 (socket says 172.21.15.57:33374) 2023-03-03T07:47:11.515 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:11.509+0000 7f5067fff700 1 -- 172.21.15.57:0/2344732915 learned_addr learned my addr 172.21.15.57:0/2344732915 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:47:11.515 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:11.509+0000 7f5067fff700 1 -- 172.21.15.57:0/2344732915 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50500094b0 con 0x7f5068125870 2023-03-03T07:47:11.515 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:11.513+0000 7f5067fff700 1 --2- 172.21.15.57:0/2344732915 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5068125870 0x7f50681bbf80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f505800c680 tx=0x7f505800ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:11.516 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:11.513+0000 7f50657fa700 1 -- 172.21.15.57:0/2344732915 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5058005cc0 con 0x7f5068125870 2023-03-03T07:47:11.516 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:11.513+0000 7f50657fa700 1 -- 172.21.15.57:0/2344732915 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5058005e20 con 0x7f5068125870 2023-03-03T07:47:11.516 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:11.513+0000 7f50657fa700 1 -- 172.21.15.57:0/2344732915 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5058007220 con 0x7f5068125870 2023-03-03T07:47:11.516 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:11.513+0000 7f506d6b8700 1 -- 172.21.15.57:0/2344732915 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f506812d520 con 0x7f5068125870 2023-03-03T07:47:11.517 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:11.513+0000 7f506d6b8700 1 -- 172.21.15.57:0/2344732915 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f506812d390 con 0x7f5068125870 2023-03-03T07:47:11.518 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:11.513+0000 7f506d6b8700 1 -- 172.21.15.57:0/2344732915 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f506812d6b0 con 0x7f5068125870 2023-03-03T07:47:11.518 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:11.513+0000 7f50657fa700 1 -- 172.21.15.57:0/2344732915 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 9) v1 ==== 42325+0+0 (secure 0 0 0) 0x7f5058019030 con 0x7f5068125870 2023-03-03T07:47:11.519 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:11.517+0000 7f50657fa700 1 --2- 172.21.15.57:0/2344732915 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f504c034910 0x7f504c036dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:11.520 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:11.517+0000 7f50657fa700 1 -- 172.21.15.57:0/2344732915 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 2928+0+0 (secure 0 0 0) 0x7f50580456b0 con 0x7f5068125870 2023-03-03T07:47:11.520 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:11.517+0000 7f505f7fe700 1 --2- 172.21.15.57:0/2344732915 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f504c034910 0x7f504c036dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:11.521 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:11.517+0000 7f505f7fe700 1 --2- 172.21.15.57:0/2344732915 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f504c034910 0x7f504c036dc0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5050006ee0 tx=0x7f5050008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:11.525 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:11.521+0000 7f50657fa700 1 -- 172.21.15.57:0/2344732915 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f50580196b0 con 0x7f5068125870 2023-03-03T07:47:11.760 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:11.757+0000 7f506d6b8700 1 -- 172.21.15.57:0/2344732915 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f50680619b0 con 0x7f5068125870 2023-03-03T07:47:11.760 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:11.757+0000 7f50657fa700 1 -- 172.21.15.57:0/2344732915 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+280 (secure 0 0 0) 0x7f5058017070 con 0x7f5068125870 2023-03-03T07:47:11.915 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:11.913+0000 7f506d6b8700 1 -- 172.21.15.57:0/2344732915 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f5068072140 con 0x7f5068125870 2023-03-03T07:47:11.916 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:11.913+0000 7f50657fa700 1 -- 172.21.15.57:0/2344732915 <== mon.0 v2:172.21.15.57:3300/0 8 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+280 (secure 0 0 0) 0x7f50580192c0 con 0x7f5068125870 2023-03-03T07:47:11.919 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:11.913+0000 7f506d6b8700 1 -- 172.21.15.57:0/2344732915 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f504c034910 msgr2=0x7f504c036dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:11.919 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:11.913+0000 7f506d6b8700 1 --2- 172.21.15.57:0/2344732915 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f504c034910 0x7f504c036dc0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5050006ee0 tx=0x7f5050008030 comp rx=0 tx=0).stop 2023-03-03T07:47:11.919 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:11.913+0000 7f506d6b8700 1 -- 172.21.15.57:0/2344732915 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5068125870 msgr2=0x7f50681bbf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:11.919 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:11.913+0000 7f506d6b8700 1 --2- 172.21.15.57:0/2344732915 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5068125870 0x7f50681bbf80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f505800c680 tx=0x7f505800ca40 comp rx=0 tx=0).stop 2023-03-03T07:47:11.921 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:11.917+0000 7f506d6b8700 1 -- 172.21.15.57:0/2344732915 shutdown_connections 2023-03-03T07:47:11.921 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:11.917+0000 7f506d6b8700 1 --2- 172.21.15.57:0/2344732915 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f504c034910 0x7f504c036dc0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:11.921 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:11.917+0000 7f506d6b8700 1 --2- 172.21.15.57:0/2344732915 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5068125870 0x7f50681bbf80 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:11.921 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:11.917+0000 7f506d6b8700 1 -- 172.21.15.57:0/2344732915 >> 172.21.15.57:0/2344732915 conn(0x7f50680943e0 msgr2=0x7f5068126b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:47:11.921 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:11.917+0000 7f506d6b8700 1 -- 172.21.15.57:0/2344732915 shutdown_connections 2023-03-03T07:47:11.921 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:11.917+0000 7f506d6b8700 1 -- 172.21.15.57:0/2344732915 wait complete. 2023-03-03T07:47:11.947 INFO:tasks.workunit.client.0.smithi057.stderr:+ health='HEALTH_WARN 1 nearfull osd(s); 4 pool(s) nearfull 2023-03-03T07:47:11.948 INFO:tasks.workunit.client.0.smithi057.stderr:[WRN] OSD_NEARFULL: 1 nearfull osd(s) 2023-03-03T07:47:11.948 INFO:tasks.workunit.client.0.smithi057.stderr: osd.0 is near full 2023-03-03T07:47:11.948 INFO:tasks.workunit.client.0.smithi057.stderr:[WRN] POOL_NEARFULL: 4 pool(s) nearfull 2023-03-03T07:47:11.948 INFO:tasks.workunit.client.0.smithi057.stderr: pool '\''.mgr'\'' is nearfull 2023-03-03T07:47:11.948 INFO:tasks.workunit.client.0.smithi057.stderr: pool '\''rbd'\'' is nearfull 2023-03-03T07:47:11.948 INFO:tasks.workunit.client.0.smithi057.stderr: pool '\''cephfs_metadata'\'' is nearfull 2023-03-03T07:47:11.949 INFO:tasks.workunit.client.0.smithi057.stderr: pool '\''cephfs_data'\'' is nearfull' 2023-03-03T07:47:11.949 INFO:tasks.workunit.client.0.smithi057.stderr:+ [[ HEALTH_WARN 1 nearfull osd(s); 4 pool(s) nearfull 2023-03-03T07:47:11.949 INFO:tasks.workunit.client.0.smithi057.stderr:[WRN] OSD_NEARFULL: 1 nearfull osd(s) 2023-03-03T07:47:11.949 INFO:tasks.workunit.client.0.smithi057.stderr: osd.0 is near full 2023-03-03T07:47:11.949 INFO:tasks.workunit.client.0.smithi057.stderr:[WRN] POOL_NEARFULL: 4 pool(s) nearfull 2023-03-03T07:47:11.949 INFO:tasks.workunit.client.0.smithi057.stderr: pool '.mgr' is nearfull 2023-03-03T07:47:11.949 INFO:tasks.workunit.client.0.smithi057.stderr: pool 'rbd' is nearfull 2023-03-03T07:47:11.950 INFO:tasks.workunit.client.0.smithi057.stderr: pool 'cephfs_metadata' is nearfull 2023-03-03T07:47:11.950 INFO:tasks.workunit.client.0.smithi057.stderr: pool 'cephfs_data' is nearfull = *\O\S\D\_\F\U\L\L* ]] 2023-03-03T07:47:11.950 INFO:tasks.workunit.client.0.smithi057.stderr:+ echo 'Wating for osd to be full: 81' 2023-03-03T07:47:11.950 INFO:tasks.workunit.client.0.smithi057.stdout:Wating for osd to be full: 81 2023-03-03T07:47:11.951 INFO:tasks.workunit.client.0.smithi057.stderr:+ sleep 1 2023-03-03T07:47:12.954 INFO:tasks.workunit.client.0.smithi057.stderr:+ let timeout-=1 2023-03-03T07:47:12.955 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 80 -gt 0 ']' 2023-03-03T07:47:12.957 INFO:tasks.workunit.client.0.smithi057.stderr:++ ceph health detail 2023-03-03T07:47:13.122 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:13.117+0000 7fcb356d7700 1 Processor -- start 2023-03-03T07:47:13.122 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:13.117+0000 7fcb356d7700 1 -- start start 2023-03-03T07:47:13.124 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:13.121+0000 7fcb356d7700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcb3008afb0 0x7fcb3008b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:13.124 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:13.121+0000 7fcb356d7700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb30071ca0 con 0x7fcb3008b8c0 2023-03-03T07:47:13.124 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:13.121+0000 7fcb356d7700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb3008d490 con 0x7fcb3008afb0 2023-03-03T07:47:13.125 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:13.121+0000 7fcb2f7fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fcb3008b8c0 0x7fcb30127fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57164/0 (socket says 172.21.15.57:57164) 2023-03-03T07:47:13.125 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:13.121+0000 7fcb2f7fe700 1 -- 172.21.15.57:0/1864708469 learned_addr learned my addr 172.21.15.57:0/1864708469 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:47:13.125 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:13.121+0000 7fcb2ffff700 1 --2- 172.21.15.57:0/1864708469 >> v2:172.21.15.57:3300/0 conn(0x7fcb3008afb0 0x7fcb3008b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:13.126 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:13.121+0000 7fcb2effd700 1 -- 172.21.15.57:0/1864708469 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1310560847 0 0) 0x7fcb30071ca0 con 0x7fcb3008b8c0 2023-03-03T07:47:13.126 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:13.121+0000 7fcb2effd700 1 -- 172.21.15.57:0/1864708469 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb180035d0 con 0x7fcb3008b8c0 2023-03-03T07:47:13.126 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:13.121+0000 7fcb2ffff700 1 -- 172.21.15.57:0/1864708469 >> v1:172.21.15.57:6789/0 conn(0x7fcb3008b8c0 legacy=0x7fcb30127fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:13.126 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:13.121+0000 7fcb2effd700 1 -- 172.21.15.57:0/1864708469 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3615033144 0 0) 0x7fcb180035d0 con 0x7fcb3008b8c0 2023-03-03T07:47:13.127 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:13.121+0000 7fcb2ffff700 1 -- 172.21.15.57:0/1864708469 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb3008c5c0 con 0x7fcb3008afb0 2023-03-03T07:47:13.127 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:13.121+0000 7fcb2ffff700 1 --2- 172.21.15.57:0/1864708469 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb3008afb0 0x7fcb3008b380 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fcb2000a970 tx=0x7fcb2000ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bc4e7b6697f150b server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:13.128 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:13.125+0000 7fcb2effd700 1 -- 172.21.15.57:0/1864708469 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcb240015a0 con 0x7fcb3008afb0 2023-03-03T07:47:13.128 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:13.125+0000 7fcb2effd700 1 -- 172.21.15.57:0/1864708469 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb20004030 con 0x7fcb3008afb0 2023-03-03T07:47:13.128 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:13.125+0000 7fcb2effd700 1 -- 172.21.15.57:0/1864708469 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcb200042f0 con 0x7fcb3008afb0 2023-03-03T07:47:13.129 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:13.125+0000 7fcb356d7700 1 -- 172.21.15.57:0/1864708469 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb3008afb0 msgr2=0x7fcb3008b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:13.129 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:13.125+0000 7fcb356d7700 1 --2- 172.21.15.57:0/1864708469 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb3008afb0 0x7fcb3008b380 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fcb2000a970 tx=0x7fcb2000ac80 comp rx=0 tx=0).stop 2023-03-03T07:47:13.129 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:13.125+0000 7fcb356d7700 1 -- 172.21.15.57:0/1864708469 shutdown_connections 2023-03-03T07:47:13.129 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:13.125+0000 7fcb356d7700 1 --2- 172.21.15.57:0/1864708469 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb3008afb0 0x7fcb3008b380 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:13.130 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:13.125+0000 7fcb356d7700 1 -- 172.21.15.57:0/1864708469 >> 172.21.15.57:0/1864708469 conn(0x7fcb300943e0 msgr2=0x7fcb30095e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:47:13.130 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:13.125+0000 7fcb356d7700 1 -- 172.21.15.57:0/1864708469 shutdown_connections 2023-03-03T07:47:13.130 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:13.125+0000 7fcb356d7700 1 -- 172.21.15.57:0/1864708469 wait complete. 2023-03-03T07:47:13.131 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:13.125+0000 7fcb356d7700 1 Processor -- start 2023-03-03T07:47:13.132 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:13.129+0000 7fcb356d7700 1 -- start start 2023-03-03T07:47:13.132 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:13.129+0000 7fcb356d7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb3008afb0 0x7fcb301b9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:13.132 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:13.129+0000 7fcb356d7700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb301b98a0 con 0x7fcb3008afb0 2023-03-03T07:47:13.133 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:13.129+0000 7fcb2ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb3008afb0 0x7fcb301b9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:13.133 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:13.129+0000 7fcb2ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb3008afb0 0x7fcb301b9df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33390/0 (socket says 172.21.15.57:33390) 2023-03-03T07:47:13.133 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:13.129+0000 7fcb2ffff700 1 -- 172.21.15.57:0/2163249379 learned_addr learned my addr 172.21.15.57:0/2163249379 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:47:13.134 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:13.129+0000 7fcb2ffff700 1 -- 172.21.15.57:0/2163249379 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb2000a650 con 0x7fcb3008afb0 2023-03-03T07:47:13.135 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:13.129+0000 7fcb2ffff700 1 --2- 172.21.15.57:0/2163249379 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb3008afb0 0x7fcb301b9df0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fcb20000c00 tx=0x7fcb200047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:13.135 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:13.129+0000 7fcb2cff9700 1 -- 172.21.15.57:0/2163249379 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcb2001e070 con 0x7fcb3008afb0 2023-03-03T07:47:13.135 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:13.129+0000 7fcb2cff9700 1 -- 172.21.15.57:0/2163249379 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb2000c7b0 con 0x7fcb3008afb0 2023-03-03T07:47:13.135 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:13.129+0000 7fcb2cff9700 1 -- 172.21.15.57:0/2163249379 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcb2000ca50 con 0x7fcb3008afb0 2023-03-03T07:47:13.136 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:13.129+0000 7fcb356d7700 1 -- 172.21.15.57:0/2163249379 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb30069f30 con 0x7fcb3008afb0 2023-03-03T07:47:13.136 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:13.133+0000 7fcb356d7700 1 -- 172.21.15.57:0/2163249379 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb30069da0 con 0x7fcb3008afb0 2023-03-03T07:47:13.137 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:13.133+0000 7fcb2cff9700 1 -- 172.21.15.57:0/2163249379 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 9) v1 ==== 42325+0+0 (secure 0 0 0) 0x7fcb2002a030 con 0x7fcb3008afb0 2023-03-03T07:47:13.138 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:13.133+0000 7fcb356d7700 1 -- 172.21.15.57:0/2163249379 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb301296d0 con 0x7fcb3008afb0 2023-03-03T07:47:13.138 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:13.133+0000 7fcb2cff9700 1 --2- 172.21.15.57:0/2163249379 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fcb1c034910 0x7fcb1c036dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:13.138 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:13.133+0000 7fcb2cff9700 1 -- 172.21.15.57:0/2163249379 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 2928+0+0 (secure 0 0 0) 0x7fcb200475c0 con 0x7fcb3008afb0 2023-03-03T07:47:13.139 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:13.133+0000 7fcb2f7fe700 1 --2- 172.21.15.57:0/2163249379 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fcb1c034910 0x7fcb1c036dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:13.140 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:13.137+0000 7fcb2f7fe700 1 --2- 172.21.15.57:0/2163249379 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fcb1c034910 0x7fcb1c036dc0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcb24000c00 tx=0x7fcb24001100 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:13.146 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:13.141+0000 7fcb2cff9700 1 -- 172.21.15.57:0/2163249379 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fcb20017990 con 0x7fcb3008afb0 2023-03-03T07:47:13.383 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:13.377+0000 7fcb356d7700 1 -- 172.21.15.57:0/2163249379 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fcb301b99e0 con 0x7fcb3008afb0 2023-03-03T07:47:13.384 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:13.381+0000 7fcb2cff9700 1 -- 172.21.15.57:0/2163249379 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+280 (secure 0 0 0) 0x7fcb301b99e0 con 0x7fcb3008afb0 2023-03-03T07:47:13.545 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:13.541+0000 7fcb356d7700 1 -- 172.21.15.57:0/2163249379 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fcb301b99e0 con 0x7fcb3008afb0 2023-03-03T07:47:13.546 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:13.541+0000 7fcb2cff9700 1 -- 172.21.15.57:0/2163249379 <== mon.0 v2:172.21.15.57:3300/0 8 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+280 (secure 0 0 0) 0x7fcb301b99e0 con 0x7fcb3008afb0 2023-03-03T07:47:13.551 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:13.545+0000 7fcb356d7700 1 -- 172.21.15.57:0/2163249379 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fcb1c034910 msgr2=0x7fcb1c036dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:13.551 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:13.545+0000 7fcb356d7700 1 --2- 172.21.15.57:0/2163249379 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fcb1c034910 0x7fcb1c036dc0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcb24000c00 tx=0x7fcb24001100 comp rx=0 tx=0).stop 2023-03-03T07:47:13.551 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:13.545+0000 7fcb356d7700 1 -- 172.21.15.57:0/2163249379 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb3008afb0 msgr2=0x7fcb301b9df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:13.551 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:13.545+0000 7fcb356d7700 1 --2- 172.21.15.57:0/2163249379 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb3008afb0 0x7fcb301b9df0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fcb20000c00 tx=0x7fcb200047e0 comp rx=0 tx=0).stop 2023-03-03T07:47:13.552 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:13.545+0000 7fcb356d7700 1 -- 172.21.15.57:0/2163249379 shutdown_connections 2023-03-03T07:47:13.552 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:13.545+0000 7fcb356d7700 1 --2- 172.21.15.57:0/2163249379 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fcb1c034910 0x7fcb1c036dc0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:13.552 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:13.545+0000 7fcb356d7700 1 --2- 172.21.15.57:0/2163249379 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb3008afb0 0x7fcb301b9df0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:13.552 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:13.545+0000 7fcb356d7700 1 -- 172.21.15.57:0/2163249379 >> 172.21.15.57:0/2163249379 conn(0x7fcb300943e0 msgr2=0x7fcb3008f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:47:13.552 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:13.549+0000 7fcb356d7700 1 -- 172.21.15.57:0/2163249379 shutdown_connections 2023-03-03T07:47:13.553 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:13.549+0000 7fcb356d7700 1 -- 172.21.15.57:0/2163249379 wait complete. 2023-03-03T07:47:13.580 INFO:tasks.workunit.client.0.smithi057.stderr:+ health='HEALTH_WARN 1 nearfull osd(s); 4 pool(s) nearfull 2023-03-03T07:47:13.580 INFO:tasks.workunit.client.0.smithi057.stderr:[WRN] OSD_NEARFULL: 1 nearfull osd(s) 2023-03-03T07:47:13.581 INFO:tasks.workunit.client.0.smithi057.stderr: osd.0 is near full 2023-03-03T07:47:13.581 INFO:tasks.workunit.client.0.smithi057.stderr:[WRN] POOL_NEARFULL: 4 pool(s) nearfull 2023-03-03T07:47:13.581 INFO:tasks.workunit.client.0.smithi057.stderr: pool '\''.mgr'\'' is nearfull 2023-03-03T07:47:13.581 INFO:tasks.workunit.client.0.smithi057.stderr: pool '\''rbd'\'' is nearfull 2023-03-03T07:47:13.581 INFO:tasks.workunit.client.0.smithi057.stderr: pool '\''cephfs_metadata'\'' is nearfull 2023-03-03T07:47:13.581 INFO:tasks.workunit.client.0.smithi057.stderr: pool '\''cephfs_data'\'' is nearfull' 2023-03-03T07:47:13.582 INFO:tasks.workunit.client.0.smithi057.stderr:+ [[ HEALTH_WARN 1 nearfull osd(s); 4 pool(s) nearfull 2023-03-03T07:47:13.582 INFO:tasks.workunit.client.0.smithi057.stderr:[WRN] OSD_NEARFULL: 1 nearfull osd(s) 2023-03-03T07:47:13.582 INFO:tasks.workunit.client.0.smithi057.stderr: osd.0 is near full 2023-03-03T07:47:13.582 INFO:tasks.workunit.client.0.smithi057.stderr:[WRN] POOL_NEARFULL: 4 pool(s) nearfull 2023-03-03T07:47:13.582 INFO:tasks.workunit.client.0.smithi057.stderr: pool '.mgr' is nearfull 2023-03-03T07:47:13.582 INFO:tasks.workunit.client.0.smithi057.stderr: pool 'rbd' is nearfull 2023-03-03T07:47:13.582 INFO:tasks.workunit.client.0.smithi057.stderr: pool 'cephfs_metadata' is nearfull 2023-03-03T07:47:13.583 INFO:tasks.workunit.client.0.smithi057.stderr: pool 'cephfs_data' is nearfull = *\O\S\D\_\F\U\L\L* ]] 2023-03-03T07:47:13.583 INFO:tasks.workunit.client.0.smithi057.stdout:Wating for osd to be full: 80 2023-03-03T07:47:13.583 INFO:tasks.workunit.client.0.smithi057.stderr:+ echo 'Wating for osd to be full: 80' 2023-03-03T07:47:13.583 INFO:tasks.workunit.client.0.smithi057.stderr:+ sleep 1 2023-03-03T07:47:14.587 INFO:tasks.workunit.client.0.smithi057.stderr:+ let timeout-=1 2023-03-03T07:47:14.588 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 79 -gt 0 ']' 2023-03-03T07:47:14.590 INFO:tasks.workunit.client.0.smithi057.stderr:++ ceph health detail 2023-03-03T07:47:14.761 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:14.757+0000 7f22e4cb8700 1 Processor -- start 2023-03-03T07:47:14.762 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:14.757+0000 7f22e4cb8700 1 -- start start 2023-03-03T07:47:14.764 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:14.761+0000 7f22e4cb8700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f22e0091a10 0x7f22e008e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:14.764 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:14.761+0000 7f22e4cb8700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22e00911f0 con 0x7f22e0091de0 2023-03-03T07:47:14.765 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:14.761+0000 7f22e4cb8700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22e00662f0 con 0x7f22e0091a10 2023-03-03T07:47:14.765 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:14.761+0000 7f22df7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f22e0091a10 0x7f22e008e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:14.765 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:14.761+0000 7f22deffd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f22e0091de0 0x7f22e008ec70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57178/0 (socket says 172.21.15.57:57178) 2023-03-03T07:47:14.765 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:14.761+0000 7f22deffd700 1 -- 172.21.15.57:0/1525104622 learned_addr learned my addr 172.21.15.57:0/1525104622 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:47:14.765 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:14.761+0000 7f22de7fc700 1 -- 172.21.15.57:0/1525104622 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3054143846 0 0) 0x7f22e00911f0 con 0x7f22e0091de0 2023-03-03T07:47:14.766 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:14.761+0000 7f22df7fe700 1 -- 172.21.15.57:0/1525104622 >> v1:172.21.15.57:6789/0 conn(0x7f22e0091de0 legacy=0x7f22e008ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:14.766 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:14.761+0000 7f22df7fe700 1 -- 172.21.15.57:0/1525104622 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e0066700 con 0x7f22e0091a10 2023-03-03T07:47:14.766 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:14.761+0000 7f22df7fe700 1 --2- 172.21.15.57:0/1525104622 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22e0091a10 0x7f22e008e730 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f22d00097d0 tx=0x7f22d0009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b2ce3ef139f3853 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:14.767 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:14.761+0000 7f22de7fc700 1 -- 172.21.15.57:0/1525104622 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f22d00041c0 con 0x7f22e0091a10 2023-03-03T07:47:14.767 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:14.761+0000 7f22de7fc700 1 -- 172.21.15.57:0/1525104622 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d0004320 con 0x7f22e0091a10 2023-03-03T07:47:14.767 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:14.761+0000 7f22de7fc700 1 -- 172.21.15.57:0/1525104622 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f22d00036c0 con 0x7f22e0091a10 2023-03-03T07:47:14.768 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:14.761+0000 7f22e4cb8700 1 -- 172.21.15.57:0/1525104622 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22e0091a10 msgr2=0x7f22e008e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:14.768 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:14.761+0000 7f22e4cb8700 1 --2- 172.21.15.57:0/1525104622 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22e0091a10 0x7f22e008e730 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f22d00097d0 tx=0x7f22d0009ae0 comp rx=0 tx=0).stop 2023-03-03T07:47:14.768 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:14.765+0000 7f22e4cb8700 1 -- 172.21.15.57:0/1525104622 shutdown_connections 2023-03-03T07:47:14.768 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:14.765+0000 7f22e4cb8700 1 --2- 172.21.15.57:0/1525104622 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22e0091a10 0x7f22e008e730 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:14.768 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:14.765+0000 7f22e4cb8700 1 -- 172.21.15.57:0/1525104622 >> 172.21.15.57:0/1525104622 conn(0x7f22e008a3c0 msgr2=0x7f22e008c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:47:14.768 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:14.765+0000 7f22e4cb8700 1 -- 172.21.15.57:0/1525104622 shutdown_connections 2023-03-03T07:47:14.769 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:14.765+0000 7f22e4cb8700 1 -- 172.21.15.57:0/1525104622 wait complete. 2023-03-03T07:47:14.769 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:14.765+0000 7f22e4cb8700 1 Processor -- start 2023-03-03T07:47:14.770 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:14.765+0000 7f22e4cb8700 1 -- start start 2023-03-03T07:47:14.771 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:14.765+0000 7f22e4cb8700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22e0091a10 0x7f22e01bbc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:14.771 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:14.765+0000 7f22e4cb8700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e011c590 con 0x7f22e0091a10 2023-03-03T07:47:14.772 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:14.769+0000 7f22df7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22e0091a10 0x7f22e01bbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:14.772 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:14.769+0000 7f22df7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22e0091a10 0x7f22e01bbc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33408/0 (socket says 172.21.15.57:33408) 2023-03-03T07:47:14.772 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:14.769+0000 7f22df7fe700 1 -- 172.21.15.57:0/3814432869 learned_addr learned my addr 172.21.15.57:0/3814432869 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:47:14.773 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:14.769+0000 7f22df7fe700 1 -- 172.21.15.57:0/3814432869 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d00094b0 con 0x7f22e0091a10 2023-03-03T07:47:14.773 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:14.769+0000 7f22df7fe700 1 --2- 172.21.15.57:0/3814432869 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22e0091a10 0x7f22e01bbc70 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f22d00090b0 tx=0x7f22d0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:14.773 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:14.769+0000 7f22c7fff700 1 -- 172.21.15.57:0/3814432869 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f22d0006ea0 con 0x7f22e0091a10 2023-03-03T07:47:14.774 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:14.769+0000 7f22c7fff700 1 -- 172.21.15.57:0/3814432869 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d0011760 con 0x7f22e0091a10 2023-03-03T07:47:14.774 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:14.769+0000 7f22c7fff700 1 -- 172.21.15.57:0/3814432869 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f22d0011a20 con 0x7f22e0091a10 2023-03-03T07:47:14.774 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:14.769+0000 7f22e4cb8700 1 -- 172.21.15.57:0/3814432869 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22e0090f00 con 0x7f22e0091a10 2023-03-03T07:47:14.774 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:14.769+0000 7f22e4cb8700 1 -- 172.21.15.57:0/3814432869 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22e008f590 con 0x7f22e0091a10 2023-03-03T07:47:14.775 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:14.773+0000 7f22c7fff700 1 -- 172.21.15.57:0/3814432869 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 9) v1 ==== 42325+0+0 (secure 0 0 0) 0x7f22d002d070 con 0x7f22e0091a10 2023-03-03T07:47:14.776 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:14.773+0000 7f22e4cb8700 1 -- 172.21.15.57:0/3814432869 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22e012d720 con 0x7f22e0091a10 2023-03-03T07:47:14.777 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:14.773+0000 7f22c7fff700 1 --2- 172.21.15.57:0/3814432869 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f22cc034960 0x7f22cc036e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:14.777 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:14.773+0000 7f22c7fff700 1 -- 172.21.15.57:0/3814432869 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 2928+0+0 (secure 0 0 0) 0x7f22d0047300 con 0x7f22e0091a10 2023-03-03T07:47:14.777 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:14.773+0000 7f22deffd700 1 --2- 172.21.15.57:0/3814432869 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f22cc034960 0x7f22cc036e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:14.778 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:14.773+0000 7f22deffd700 1 --2- 172.21.15.57:0/3814432869 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f22cc034960 0x7f22cc036e10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f22d4000c00 tx=0x7f22d40079c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:14.784 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:14.781+0000 7f22c7fff700 1 -- 172.21.15.57:0/3814432869 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f22d0024950 con 0x7f22e0091a10 2023-03-03T07:47:15.025 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:15.021+0000 7f22e4cb8700 1 -- 172.21.15.57:0/3814432869 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f22e00619b0 con 0x7f22e0091a10 2023-03-03T07:47:15.026 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:15.021+0000 7f22c7fff700 1 -- 172.21.15.57:0/3814432869 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+280 (secure 0 0 0) 0x7f22d0016020 con 0x7f22e0091a10 2023-03-03T07:47:15.189 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:15.185+0000 7f22e4cb8700 1 -- 172.21.15.57:0/3814432869 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f22e011c6d0 con 0x7f22e0091a10 2023-03-03T07:47:15.190 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:15.185+0000 7f22c7fff700 1 -- 172.21.15.57:0/3814432869 <== mon.0 v2:172.21.15.57:3300/0 8 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+280 (secure 0 0 0) 0x7f22d0016020 con 0x7f22e0091a10 2023-03-03T07:47:15.193 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:15.189+0000 7f22e4cb8700 1 -- 172.21.15.57:0/3814432869 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f22cc034960 msgr2=0x7f22cc036e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:15.194 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:15.189+0000 7f22e4cb8700 1 --2- 172.21.15.57:0/3814432869 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f22cc034960 0x7f22cc036e10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f22d4000c00 tx=0x7f22d40079c0 comp rx=0 tx=0).stop 2023-03-03T07:47:15.194 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:15.189+0000 7f22e4cb8700 1 -- 172.21.15.57:0/3814432869 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22e0091a10 msgr2=0x7f22e01bbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:15.194 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:15.189+0000 7f22e4cb8700 1 --2- 172.21.15.57:0/3814432869 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22e0091a10 0x7f22e01bbc70 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f22d00090b0 tx=0x7f22d0004770 comp rx=0 tx=0).stop 2023-03-03T07:47:15.194 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:15.189+0000 7f22e4cb8700 1 -- 172.21.15.57:0/3814432869 shutdown_connections 2023-03-03T07:47:15.194 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:15.189+0000 7f22e4cb8700 1 --2- 172.21.15.57:0/3814432869 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f22cc034960 0x7f22cc036e10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:15.194 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:15.189+0000 7f22e4cb8700 1 --2- 172.21.15.57:0/3814432869 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22e0091a10 0x7f22e01bbc70 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:15.194 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:15.189+0000 7f22e4cb8700 1 -- 172.21.15.57:0/3814432869 >> 172.21.15.57:0/3814432869 conn(0x7f22e008a3c0 msgr2=0x7f22e012c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:47:15.195 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:15.189+0000 7f22e4cb8700 1 -- 172.21.15.57:0/3814432869 shutdown_connections 2023-03-03T07:47:15.195 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:15.189+0000 7f22e4cb8700 1 -- 172.21.15.57:0/3814432869 wait complete. 2023-03-03T07:47:15.221 INFO:tasks.workunit.client.0.smithi057.stderr:+ health='HEALTH_WARN 1 nearfull osd(s); 4 pool(s) nearfull 2023-03-03T07:47:15.221 INFO:tasks.workunit.client.0.smithi057.stderr:[WRN] OSD_NEARFULL: 1 nearfull osd(s) 2023-03-03T07:47:15.221 INFO:tasks.workunit.client.0.smithi057.stderr: osd.0 is near full 2023-03-03T07:47:15.221 INFO:tasks.workunit.client.0.smithi057.stderr:[WRN] POOL_NEARFULL: 4 pool(s) nearfull 2023-03-03T07:47:15.222 INFO:tasks.workunit.client.0.smithi057.stderr: pool '\''.mgr'\'' is nearfull 2023-03-03T07:47:15.222 INFO:tasks.workunit.client.0.smithi057.stderr: pool '\''rbd'\'' is nearfull 2023-03-03T07:47:15.222 INFO:tasks.workunit.client.0.smithi057.stderr: pool '\''cephfs_metadata'\'' is nearfull 2023-03-03T07:47:15.222 INFO:tasks.workunit.client.0.smithi057.stderr: pool '\''cephfs_data'\'' is nearfull' 2023-03-03T07:47:15.222 INFO:tasks.workunit.client.0.smithi057.stderr:+ [[ HEALTH_WARN 1 nearfull osd(s); 4 pool(s) nearfull 2023-03-03T07:47:15.222 INFO:tasks.workunit.client.0.smithi057.stderr:[WRN] OSD_NEARFULL: 1 nearfull osd(s) 2023-03-03T07:47:15.222 INFO:tasks.workunit.client.0.smithi057.stderr: osd.0 is near full 2023-03-03T07:47:15.222 INFO:tasks.workunit.client.0.smithi057.stderr:[WRN] POOL_NEARFULL: 4 pool(s) nearfull 2023-03-03T07:47:15.223 INFO:tasks.workunit.client.0.smithi057.stderr: pool '.mgr' is nearfull 2023-03-03T07:47:15.223 INFO:tasks.workunit.client.0.smithi057.stderr: pool 'rbd' is nearfull 2023-03-03T07:47:15.223 INFO:tasks.workunit.client.0.smithi057.stderr: pool 'cephfs_metadata' is nearfull 2023-03-03T07:47:15.223 INFO:tasks.workunit.client.0.smithi057.stderr: pool 'cephfs_data' is nearfull = *\O\S\D\_\F\U\L\L* ]] 2023-03-03T07:47:15.223 INFO:tasks.workunit.client.0.smithi057.stderr:+ echo 'Wating for osd to be full: 79' 2023-03-03T07:47:15.223 INFO:tasks.workunit.client.0.smithi057.stdout:Wating for osd to be full: 79 2023-03-03T07:47:15.224 INFO:tasks.workunit.client.0.smithi057.stderr:+ sleep 1 2023-03-03T07:47:16.228 INFO:tasks.workunit.client.0.smithi057.stderr:+ let timeout-=1 2023-03-03T07:47:16.228 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 78 -gt 0 ']' 2023-03-03T07:47:16.229 INFO:tasks.workunit.client.0.smithi057.stderr:++ ceph health detail 2023-03-03T07:47:16.422 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:16.417+0000 7fbf6f0a4700 1 Processor -- start 2023-03-03T07:47:16.422 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:16.417+0000 7fbf6f0a4700 1 -- start start 2023-03-03T07:47:16.423 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:16.421+0000 7fbf6f0a4700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbf6808c340 0x7fbf6808c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:16.424 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:16.421+0000 7fbf6f0a4700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf68066700 con 0x7fbf6808cc50 2023-03-03T07:47:16.424 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:16.421+0000 7fbf6f0a4700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf68066000 con 0x7fbf6808c340 2023-03-03T07:47:16.424 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:16.421+0000 7fbf6d8a1700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fbf6808cc50 0x7fbf68122690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57194/0 (socket says 172.21.15.57:57194) 2023-03-03T07:47:16.424 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:16.421+0000 7fbf6d8a1700 1 -- 172.21.15.57:0/3014264874 learned_addr learned my addr 172.21.15.57:0/3014264874 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:47:16.425 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:16.421+0000 7fbf6e0a2700 1 --2- 172.21.15.57:0/3014264874 >> v2:172.21.15.57:3300/0 conn(0x7fbf6808c340 0x7fbf6808c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:16.425 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:16.421+0000 7fbf6d0a0700 1 -- 172.21.15.57:0/3014264874 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1017594230 0 0) 0x7fbf68066700 con 0x7fbf6808cc50 2023-03-03T07:47:16.425 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:16.421+0000 7fbf6d0a0700 1 -- 172.21.15.57:0/3014264874 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf540035d0 con 0x7fbf6808cc50 2023-03-03T07:47:16.426 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:16.421+0000 7fbf6e0a2700 1 -- 172.21.15.57:0/3014264874 >> v1:172.21.15.57:6789/0 conn(0x7fbf6808cc50 legacy=0x7fbf68122690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:16.426 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:16.421+0000 7fbf6e0a2700 1 -- 172.21.15.57:0/3014264874 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf6808d860 con 0x7fbf6808c340 2023-03-03T07:47:16.426 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:16.421+0000 7fbf6e0a2700 1 --2- 172.21.15.57:0/3014264874 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf6808c340 0x7fbf6808c710 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fbf640097d0 tx=0x7fbf64009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f309c44a4053f10 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:16.428 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:16.421+0000 7fbf6d0a0700 1 -- 172.21.15.57:0/3014264874 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbf64004160 con 0x7fbf6808c340 2023-03-03T07:47:16.428 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:16.421+0000 7fbf6d0a0700 1 -- 172.21.15.57:0/3014264874 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf640042c0 con 0x7fbf6808c340 2023-03-03T07:47:16.428 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:16.421+0000 7fbf6d0a0700 1 -- 172.21.15.57:0/3014264874 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbf640045a0 con 0x7fbf6808c340 2023-03-03T07:47:16.429 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:16.425+0000 7fbf6f0a4700 1 -- 172.21.15.57:0/3014264874 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf6808c340 msgr2=0x7fbf6808c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:16.429 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:16.425+0000 7fbf6f0a4700 1 --2- 172.21.15.57:0/3014264874 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf6808c340 0x7fbf6808c710 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fbf640097d0 tx=0x7fbf64009ae0 comp rx=0 tx=0).stop 2023-03-03T07:47:16.430 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:16.425+0000 7fbf6f0a4700 1 -- 172.21.15.57:0/3014264874 shutdown_connections 2023-03-03T07:47:16.431 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:16.425+0000 7fbf6f0a4700 1 --2- 172.21.15.57:0/3014264874 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf6808c340 0x7fbf6808c710 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:16.431 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:16.425+0000 7fbf6f0a4700 1 -- 172.21.15.57:0/3014264874 >> 172.21.15.57:0/3014264874 conn(0x7fbf6806fa80 msgr2=0x7fbf6806fe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:47:16.432 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:16.425+0000 7fbf6f0a4700 1 -- 172.21.15.57:0/3014264874 shutdown_connections 2023-03-03T07:47:16.432 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:16.425+0000 7fbf6f0a4700 1 -- 172.21.15.57:0/3014264874 wait complete. 2023-03-03T07:47:16.433 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:16.429+0000 7fbf6f0a4700 1 Processor -- start 2023-03-03T07:47:16.433 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:16.429+0000 7fbf6f0a4700 1 -- start start 2023-03-03T07:47:16.434 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:16.429+0000 7fbf6f0a4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf6808c340 0x7fbf681b9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:16.434 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:16.429+0000 7fbf6f0a4700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf681b91b0 con 0x7fbf6808c340 2023-03-03T07:47:16.434 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:16.429+0000 7fbf6e0a2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf6808c340 0x7fbf681b9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:16.434 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:16.429+0000 7fbf6e0a2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf6808c340 0x7fbf681b9b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33416/0 (socket says 172.21.15.57:33416) 2023-03-03T07:47:16.434 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:16.429+0000 7fbf6e0a2700 1 -- 172.21.15.57:0/595969550 learned_addr learned my addr 172.21.15.57:0/595969550 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:47:16.435 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:16.429+0000 7fbf6e0a2700 1 -- 172.21.15.57:0/595969550 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf640094b0 con 0x7fbf6808c340 2023-03-03T07:47:16.435 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:16.429+0000 7fbf6e0a2700 1 --2- 172.21.15.57:0/595969550 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf6808c340 0x7fbf681b9b80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fbf64009b20 tx=0x7fbf64004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:16.435 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:16.429+0000 7fbf5effd700 1 -- 172.21.15.57:0/595969550 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbf64003e10 con 0x7fbf6808c340 2023-03-03T07:47:16.436 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:16.429+0000 7fbf5effd700 1 -- 172.21.15.57:0/595969550 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf6401e070 con 0x7fbf6808c340 2023-03-03T07:47:16.436 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:16.429+0000 7fbf5effd700 1 -- 172.21.15.57:0/595969550 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbf640117a0 con 0x7fbf6808c340 2023-03-03T07:47:16.436 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:16.429+0000 7fbf6f0a4700 1 -- 172.21.15.57:0/595969550 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf68122f30 con 0x7fbf6808c340 2023-03-03T07:47:16.436 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:16.433+0000 7fbf6f0a4700 1 -- 172.21.15.57:0/595969550 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf68122da0 con 0x7fbf6808c340 2023-03-03T07:47:16.437 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:16.433+0000 7fbf5effd700 1 -- 172.21.15.57:0/595969550 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 9) v1 ==== 42325+0+0 (secure 0 0 0) 0x7fbf64017020 con 0x7fbf6808c340 2023-03-03T07:47:16.437 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:16.433+0000 7fbf6f0a4700 1 -- 172.21.15.57:0/595969550 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf681230c0 con 0x7fbf6808c340 2023-03-03T07:47:16.439 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:16.433+0000 7fbf5effd700 1 --2- 172.21.15.57:0/595969550 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fbf4c034910 0x7fbf4c036dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:16.439 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:16.433+0000 7fbf5effd700 1 -- 172.21.15.57:0/595969550 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 2928+0+0 (secure 0 0 0) 0x7fbf640474b0 con 0x7fbf6808c340 2023-03-03T07:47:16.439 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:16.437+0000 7fbf6d8a1700 1 --2- 172.21.15.57:0/595969550 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fbf4c034910 0x7fbf4c036dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:16.440 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:16.437+0000 7fbf6d8a1700 1 --2- 172.21.15.57:0/595969550 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fbf4c034910 0x7fbf4c036dc0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbf58000f60 tx=0x7fbf580010a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:16.448 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:16.445+0000 7fbf5effd700 1 -- 172.21.15.57:0/595969550 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fbf64010740 con 0x7fbf6808c340 2023-03-03T07:47:16.809 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:16.805+0000 7fbf6f0a4700 1 -- 172.21.15.57:0/595969550 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fbf680619b0 con 0x7fbf6808c340 2023-03-03T07:47:16.810 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:16.805+0000 7fbf5effd700 1 -- 172.21.15.57:0/595969550 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+280 (secure 0 0 0) 0x7fbf64010380 con 0x7fbf6808c340 2023-03-03T07:47:17.056 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:17.053+0000 7fbf6f0a4700 1 -- 172.21.15.57:0/595969550 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fbf6806cb20 con 0x7fbf6808c340 2023-03-03T07:47:17.056 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:17.053+0000 7fbf5effd700 1 -- 172.21.15.57:0/595969550 <== mon.0 v2:172.21.15.57:3300/0 8 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+280 (secure 0 0 0) 0x7fbf64010560 con 0x7fbf6808c340 2023-03-03T07:47:17.060 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:17.057+0000 7fbf6f0a4700 1 -- 172.21.15.57:0/595969550 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fbf4c034910 msgr2=0x7fbf4c036dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:17.060 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:17.057+0000 7fbf6f0a4700 1 --2- 172.21.15.57:0/595969550 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fbf4c034910 0x7fbf4c036dc0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbf58000f60 tx=0x7fbf580010a0 comp rx=0 tx=0).stop 2023-03-03T07:47:17.061 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:17.057+0000 7fbf6f0a4700 1 -- 172.21.15.57:0/595969550 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf6808c340 msgr2=0x7fbf681b9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:17.061 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:17.057+0000 7fbf6f0a4700 1 --2- 172.21.15.57:0/595969550 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf6808c340 0x7fbf681b9b80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fbf64009b20 tx=0x7fbf64004770 comp rx=0 tx=0).stop 2023-03-03T07:47:17.061 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:17.057+0000 7fbf6f0a4700 1 -- 172.21.15.57:0/595969550 shutdown_connections 2023-03-03T07:47:17.062 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:17.057+0000 7fbf6f0a4700 1 --2- 172.21.15.57:0/595969550 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fbf4c034910 0x7fbf4c036dc0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:17.062 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:17.057+0000 7fbf6f0a4700 1 --2- 172.21.15.57:0/595969550 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf6808c340 0x7fbf681b9b80 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:17.062 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:17.057+0000 7fbf6f0a4700 1 -- 172.21.15.57:0/595969550 >> 172.21.15.57:0/595969550 conn(0x7fbf6806fa80 msgr2=0x7fbf6808fd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:47:17.062 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:17.057+0000 7fbf6f0a4700 1 -- 172.21.15.57:0/595969550 shutdown_connections 2023-03-03T07:47:17.062 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:17.057+0000 7fbf6f0a4700 1 -- 172.21.15.57:0/595969550 wait complete. 2023-03-03T07:47:17.094 INFO:tasks.workunit.client.0.smithi057.stderr:+ health='HEALTH_WARN 1 nearfull osd(s); 4 pool(s) nearfull 2023-03-03T07:47:17.094 INFO:tasks.workunit.client.0.smithi057.stderr:[WRN] OSD_NEARFULL: 1 nearfull osd(s) 2023-03-03T07:47:17.095 INFO:tasks.workunit.client.0.smithi057.stderr: osd.0 is near full 2023-03-03T07:47:17.095 INFO:tasks.workunit.client.0.smithi057.stderr:[WRN] POOL_NEARFULL: 4 pool(s) nearfull 2023-03-03T07:47:17.095 INFO:tasks.workunit.client.0.smithi057.stderr: pool '\''.mgr'\'' is nearfull 2023-03-03T07:47:17.095 INFO:tasks.workunit.client.0.smithi057.stderr: pool '\''rbd'\'' is nearfull 2023-03-03T07:47:17.095 INFO:tasks.workunit.client.0.smithi057.stderr: pool '\''cephfs_metadata'\'' is nearfull 2023-03-03T07:47:17.095 INFO:tasks.workunit.client.0.smithi057.stderr: pool '\''cephfs_data'\'' is nearfull' 2023-03-03T07:47:17.095 INFO:tasks.workunit.client.0.smithi057.stderr:+ [[ HEALTH_WARN 1 nearfull osd(s); 4 pool(s) nearfull 2023-03-03T07:47:17.096 INFO:tasks.workunit.client.0.smithi057.stderr:[WRN] OSD_NEARFULL: 1 nearfull osd(s) 2023-03-03T07:47:17.096 INFO:tasks.workunit.client.0.smithi057.stderr: osd.0 is near full 2023-03-03T07:47:17.096 INFO:tasks.workunit.client.0.smithi057.stderr:[WRN] POOL_NEARFULL: 4 pool(s) nearfull 2023-03-03T07:47:17.096 INFO:tasks.workunit.client.0.smithi057.stderr: pool '.mgr' is nearfull 2023-03-03T07:47:17.096 INFO:tasks.workunit.client.0.smithi057.stderr: pool 'rbd' is nearfull 2023-03-03T07:47:17.096 INFO:tasks.workunit.client.0.smithi057.stderr: pool 'cephfs_metadata' is nearfull 2023-03-03T07:47:17.097 INFO:tasks.workunit.client.0.smithi057.stderr: pool 'cephfs_data' is nearfull = *\O\S\D\_\F\U\L\L* ]] 2023-03-03T07:47:17.097 INFO:tasks.workunit.client.0.smithi057.stdout:Wating for osd to be full: 78 2023-03-03T07:47:17.097 INFO:tasks.workunit.client.0.smithi057.stderr:+ echo 'Wating for osd to be full: 78' 2023-03-03T07:47:17.098 INFO:tasks.workunit.client.0.smithi057.stderr:+ sleep 1 2023-03-03T07:47:17.823 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:47:17.817+0000 7fde4aad5700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-03T07:47:17.823 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:47:17.817+0000 7fde4aad5700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-03T07:47:17.823 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:47:17.817+0000 7fde4aad5700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-03T07:47:17.823 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:47:17.817+0000 7fde4aad5700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-03T07:47:17.824 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-03-03T07:47:17.817+0000 7fde4aad5700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-03T07:47:18.100 INFO:tasks.workunit.client.0.smithi057.stderr:+ let timeout-=1 2023-03-03T07:47:18.100 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 77 -gt 0 ']' 2023-03-03T07:47:18.102 INFO:tasks.workunit.client.0.smithi057.stderr:++ ceph health detail 2023-03-03T07:47:18.283 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:18.277+0000 7f56c14ab700 1 Processor -- start 2023-03-03T07:47:18.284 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:18.281+0000 7f56c14ab700 1 -- start start 2023-03-03T07:47:18.284 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:18.281+0000 7f56c14ab700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f56bc091a10 0x7f56bc08e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:18.286 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:18.281+0000 7f56c14ab700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56bc0911f0 con 0x7f56bc091de0 2023-03-03T07:47:18.286 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:18.281+0000 7f56c14ab700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56bc0662f0 con 0x7f56bc091a10 2023-03-03T07:47:18.286 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:18.281+0000 7f56bb7fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f56bc091de0 0x7f56bc08ec70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57198/0 (socket says 172.21.15.57:57198) 2023-03-03T07:47:18.286 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:18.281+0000 7f56bb7fe700 1 -- 172.21.15.57:0/3508363282 learned_addr learned my addr 172.21.15.57:0/3508363282 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:47:18.287 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:18.281+0000 7f56bbfff700 1 --2- 172.21.15.57:0/3508363282 >> v2:172.21.15.57:3300/0 conn(0x7f56bc091a10 0x7f56bc08e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:18.287 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:18.281+0000 7f56baffd700 1 -- 172.21.15.57:0/3508363282 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1496424931 0 0) 0x7f56bc0911f0 con 0x7f56bc091de0 2023-03-03T07:47:18.287 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:18.281+0000 7f56baffd700 1 -- 172.21.15.57:0/3508363282 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56a40035d0 con 0x7f56bc091de0 2023-03-03T07:47:18.287 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:18.281+0000 7f56bbfff700 1 -- 172.21.15.57:0/3508363282 >> v1:172.21.15.57:6789/0 conn(0x7f56bc091de0 legacy=0x7f56bc08ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:18.287 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:18.281+0000 7f56bbfff700 1 -- 172.21.15.57:0/3508363282 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56bc066700 con 0x7f56bc091a10 2023-03-03T07:47:18.288 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:18.285+0000 7f56bbfff700 1 --2- 172.21.15.57:0/3508363282 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56bc091a10 0x7f56bc08e730 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f56ac0097d0 tx=0x7f56ac009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbe778d5c3c13dcb server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:18.288 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:18.285+0000 7f56baffd700 1 -- 172.21.15.57:0/3508363282 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f56ac004160 con 0x7f56bc091a10 2023-03-03T07:47:18.288 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:18.285+0000 7f56baffd700 1 -- 172.21.15.57:0/3508363282 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56ac0042c0 con 0x7f56bc091a10 2023-03-03T07:47:18.288 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:18.285+0000 7f56baffd700 1 -- 172.21.15.57:0/3508363282 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f56ac0045a0 con 0x7f56bc091a10 2023-03-03T07:47:18.289 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:18.285+0000 7f56c14ab700 1 -- 172.21.15.57:0/3508363282 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56bc091a10 msgr2=0x7f56bc08e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:18.289 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:18.285+0000 7f56c14ab700 1 --2- 172.21.15.57:0/3508363282 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56bc091a10 0x7f56bc08e730 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f56ac0097d0 tx=0x7f56ac009ae0 comp rx=0 tx=0).stop 2023-03-03T07:47:18.290 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:18.285+0000 7f56c14ab700 1 -- 172.21.15.57:0/3508363282 shutdown_connections 2023-03-03T07:47:18.290 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:18.285+0000 7f56c14ab700 1 --2- 172.21.15.57:0/3508363282 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56bc091a10 0x7f56bc08e730 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:18.290 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:18.285+0000 7f56c14ab700 1 -- 172.21.15.57:0/3508363282 >> 172.21.15.57:0/3508363282 conn(0x7f56bc08a3c0 msgr2=0x7f56bc08c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:47:18.290 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:18.285+0000 7f56c14ab700 1 -- 172.21.15.57:0/3508363282 shutdown_connections 2023-03-03T07:47:18.290 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:18.285+0000 7f56c14ab700 1 -- 172.21.15.57:0/3508363282 wait complete. 2023-03-03T07:47:18.292 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:18.289+0000 7f56c14ab700 1 Processor -- start 2023-03-03T07:47:18.293 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:18.289+0000 7f56c14ab700 1 -- start start 2023-03-03T07:47:18.293 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:18.289+0000 7f56c14ab700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56bc091a10 0x7f56bc1bbc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:18.294 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:18.289+0000 7f56c14ab700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56bc11d680 con 0x7f56bc091a10 2023-03-03T07:47:18.294 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:18.289+0000 7f56bbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56bc091a10 0x7f56bc1bbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:18.294 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:18.289+0000 7f56bbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56bc091a10 0x7f56bc1bbc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33448/0 (socket says 172.21.15.57:33448) 2023-03-03T07:47:18.295 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:18.289+0000 7f56bbfff700 1 -- 172.21.15.57:0/3733946609 learned_addr learned my addr 172.21.15.57:0/3733946609 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:47:18.295 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:18.289+0000 7f56bbfff700 1 -- 172.21.15.57:0/3733946609 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56ac0094b0 con 0x7f56bc091a10 2023-03-03T07:47:18.295 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:18.293+0000 7f56bbfff700 1 --2- 172.21.15.57:0/3733946609 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56bc091a10 0x7f56bc1bbc70 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f56ac0090b0 tx=0x7f56ac004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:18.296 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:18.293+0000 7f56b8ff9700 1 -- 172.21.15.57:0/3733946609 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f56ac003cc0 con 0x7f56bc091a10 2023-03-03T07:47:18.296 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:18.293+0000 7f56b8ff9700 1 -- 172.21.15.57:0/3733946609 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56ac01f070 con 0x7f56bc091a10 2023-03-03T07:47:18.296 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:18.293+0000 7f56b8ff9700 1 -- 172.21.15.57:0/3733946609 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f56ac011630 con 0x7f56bc091a10 2023-03-03T07:47:18.297 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:18.293+0000 7f56c14ab700 1 -- 172.21.15.57:0/3733946609 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56bc090f00 con 0x7f56bc091a10 2023-03-03T07:47:18.297 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:18.293+0000 7f56c14ab700 1 -- 172.21.15.57:0/3733946609 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56bc08f590 con 0x7f56bc091a10 2023-03-03T07:47:18.298 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:18.293+0000 7f56c14ab700 1 -- 172.21.15.57:0/3733946609 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56bc12d720 con 0x7f56bc091a10 2023-03-03T07:47:18.299 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:18.293+0000 7f56b8ff9700 1 -- 172.21.15.57:0/3733946609 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 9) v1 ==== 42325+0+0 (secure 0 0 0) 0x7f56ac02a020 con 0x7f56bc091a10 2023-03-03T07:47:18.300 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:18.297+0000 7f56b8ff9700 1 --2- 172.21.15.57:0/3733946609 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f56a80348b0 0x7f56a8036d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:18.300 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:18.297+0000 7f56b8ff9700 1 -- 172.21.15.57:0/3733946609 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 2928+0+0 (secure 0 0 0) 0x7f56ac047ac0 con 0x7f56bc091a10 2023-03-03T07:47:18.300 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:18.297+0000 7f56bb7fe700 1 --2- 172.21.15.57:0/3733946609 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f56a80348b0 0x7f56a8036d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:18.301 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:18.297+0000 7f56bb7fe700 1 --2- 172.21.15.57:0/3733946609 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f56a80348b0 0x7f56a8036d60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f56bc092210 tx=0x7f56b0007a20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:18.307 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:18.301+0000 7f56b8ff9700 1 -- 172.21.15.57:0/3733946609 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f56ac010380 con 0x7f56bc091a10 2023-03-03T07:47:18.601 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:18.597+0000 7f56c14ab700 1 -- 172.21.15.57:0/3733946609 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f56bc12d720 con 0x7f56bc091a10 2023-03-03T07:47:18.602 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:18.597+0000 7f56b8ff9700 1 -- 172.21.15.57:0/3733946609 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+280 (secure 0 0 0) 0x7f56ac032130 con 0x7f56bc091a10 2023-03-03T07:47:18.809 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:18.805+0000 7f56c14ab700 1 -- 172.21.15.57:0/3733946609 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f56bc12d720 con 0x7f56bc091a10 2023-03-03T07:47:18.810 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:18.805+0000 7f56b8ff9700 1 -- 172.21.15.57:0/3733946609 <== mon.0 v2:172.21.15.57:3300/0 8 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+280 (secure 0 0 0) 0x7f56ac032020 con 0x7f56bc091a10 2023-03-03T07:47:18.812 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:18.809+0000 7f56c14ab700 1 -- 172.21.15.57:0/3733946609 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f56a80348b0 msgr2=0x7f56a8036d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:18.812 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:18.809+0000 7f56c14ab700 1 --2- 172.21.15.57:0/3733946609 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f56a80348b0 0x7f56a8036d60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f56bc092210 tx=0x7f56b0007a20 comp rx=0 tx=0).stop 2023-03-03T07:47:18.812 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:18.809+0000 7f56c14ab700 1 -- 172.21.15.57:0/3733946609 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56bc091a10 msgr2=0x7f56bc1bbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:18.813 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:18.809+0000 7f56c14ab700 1 --2- 172.21.15.57:0/3733946609 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56bc091a10 0x7f56bc1bbc70 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f56ac0090b0 tx=0x7f56ac004770 comp rx=0 tx=0).stop 2023-03-03T07:47:18.813 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:18.809+0000 7f56c14ab700 1 -- 172.21.15.57:0/3733946609 shutdown_connections 2023-03-03T07:47:18.813 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:18.809+0000 7f56c14ab700 1 --2- 172.21.15.57:0/3733946609 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f56a80348b0 0x7f56a8036d60 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:18.813 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:18.809+0000 7f56c14ab700 1 --2- 172.21.15.57:0/3733946609 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56bc091a10 0x7f56bc1bbc70 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:18.814 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:18.809+0000 7f56c14ab700 1 -- 172.21.15.57:0/3733946609 >> 172.21.15.57:0/3733946609 conn(0x7f56bc08a3c0 msgr2=0x7f56bc12c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:47:18.814 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:18.809+0000 7f56c14ab700 1 -- 172.21.15.57:0/3733946609 shutdown_connections 2023-03-03T07:47:18.814 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:18.809+0000 7f56c14ab700 1 -- 172.21.15.57:0/3733946609 wait complete. 2023-03-03T07:47:18.844 INFO:tasks.workunit.client.0.smithi057.stderr:+ health='HEALTH_WARN 1 nearfull osd(s); 4 pool(s) nearfull 2023-03-03T07:47:18.844 INFO:tasks.workunit.client.0.smithi057.stderr:[WRN] OSD_NEARFULL: 1 nearfull osd(s) 2023-03-03T07:47:18.845 INFO:tasks.workunit.client.0.smithi057.stderr: osd.0 is near full 2023-03-03T07:47:18.845 INFO:tasks.workunit.client.0.smithi057.stderr:[WRN] POOL_NEARFULL: 4 pool(s) nearfull 2023-03-03T07:47:18.845 INFO:tasks.workunit.client.0.smithi057.stderr: pool '\''.mgr'\'' is nearfull 2023-03-03T07:47:18.845 INFO:tasks.workunit.client.0.smithi057.stderr: pool '\''rbd'\'' is nearfull 2023-03-03T07:47:18.845 INFO:tasks.workunit.client.0.smithi057.stderr: pool '\''cephfs_metadata'\'' is nearfull 2023-03-03T07:47:18.845 INFO:tasks.workunit.client.0.smithi057.stderr: pool '\''cephfs_data'\'' is nearfull' 2023-03-03T07:47:18.845 INFO:tasks.workunit.client.0.smithi057.stderr:+ [[ HEALTH_WARN 1 nearfull osd(s); 4 pool(s) nearfull 2023-03-03T07:47:18.846 INFO:tasks.workunit.client.0.smithi057.stderr:[WRN] OSD_NEARFULL: 1 nearfull osd(s) 2023-03-03T07:47:18.846 INFO:tasks.workunit.client.0.smithi057.stderr: osd.0 is near full 2023-03-03T07:47:18.846 INFO:tasks.workunit.client.0.smithi057.stderr:[WRN] POOL_NEARFULL: 4 pool(s) nearfull 2023-03-03T07:47:18.846 INFO:tasks.workunit.client.0.smithi057.stderr: pool '.mgr' is nearfull 2023-03-03T07:47:18.846 INFO:tasks.workunit.client.0.smithi057.stderr: pool 'rbd' is nearfull 2023-03-03T07:47:18.846 INFO:tasks.workunit.client.0.smithi057.stderr: pool 'cephfs_metadata' is nearfull 2023-03-03T07:47:18.847 INFO:tasks.workunit.client.0.smithi057.stderr: pool 'cephfs_data' is nearfull = *\O\S\D\_\F\U\L\L* ]] 2023-03-03T07:47:18.847 INFO:tasks.workunit.client.0.smithi057.stdout:Wating for osd to be full: 77 2023-03-03T07:47:18.847 INFO:tasks.workunit.client.0.smithi057.stderr:+ echo 'Wating for osd to be full: 77' 2023-03-03T07:47:18.848 INFO:tasks.workunit.client.0.smithi057.stderr:+ sleep 1 2023-03-03T07:47:19.850 INFO:tasks.workunit.client.0.smithi057.stderr:+ let timeout-=1 2023-03-03T07:47:19.850 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 76 -gt 0 ']' 2023-03-03T07:47:19.852 INFO:tasks.workunit.client.0.smithi057.stderr:++ ceph health detail 2023-03-03T07:47:20.020 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:20.017+0000 7f7974c12700 1 Processor -- start 2023-03-03T07:47:20.021 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:20.017+0000 7f7974c12700 1 -- start start 2023-03-03T07:47:20.022 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:20.017+0000 7f7974c12700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7970071250 0x7f7970071620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:20.023 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:20.017+0000 7f7974c12700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f797008c5c0 con 0x7f797008afb0 2023-03-03T07:47:20.023 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:20.017+0000 7f7974c12700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f797008d2a0 con 0x7f7970071250 2023-03-03T07:47:20.023 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:20.021+0000 7f7967fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f797008afb0 0x7f797008b3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37602/0 (socket says 172.21.15.57:37602) 2023-03-03T07:47:20.024 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:20.021+0000 7f7967fff700 1 -- 172.21.15.57:0/1900079414 learned_addr learned my addr 172.21.15.57:0/1900079414 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:47:20.024 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:20.021+0000 7f796f7fe700 1 --2- 172.21.15.57:0/1900079414 >> v2:172.21.15.57:3300/0 conn(0x7f7970071250 0x7f7970071620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:20.025 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:20.021+0000 7f796effd700 1 -- 172.21.15.57:0/1900079414 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3902113421 0 0) 0x7f797008c5c0 con 0x7f797008afb0 2023-03-03T07:47:20.026 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:20.021+0000 7f796effd700 1 -- 172.21.15.57:0/1900079414 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f795c0035d0 con 0x7f797008afb0 2023-03-03T07:47:20.026 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:20.021+0000 7f796f7fe700 1 -- 172.21.15.57:0/1900079414 >> v1:172.21.15.57:6789/0 conn(0x7f797008afb0 legacy=0x7f797008b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:20.026 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:20.021+0000 7f796f7fe700 1 -- 172.21.15.57:0/1900079414 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f797008d490 con 0x7f7970071250 2023-03-03T07:47:20.026 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:20.021+0000 7f796f7fe700 1 --2- 172.21.15.57:0/1900079414 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7970071250 0x7f7970071620 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f79600097d0 tx=0x7f7960009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71d700a9ed80b7c server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:20.027 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:20.021+0000 7f796effd700 1 -- 172.21.15.57:0/1900079414 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7960004160 con 0x7f7970071250 2023-03-03T07:47:20.027 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:20.021+0000 7f796effd700 1 -- 172.21.15.57:0/1900079414 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79600042c0 con 0x7f7970071250 2023-03-03T07:47:20.027 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:20.021+0000 7f796effd700 1 -- 172.21.15.57:0/1900079414 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79600045a0 con 0x7f7970071250 2023-03-03T07:47:20.028 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:20.025+0000 7f7974c12700 1 -- 172.21.15.57:0/1900079414 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7970071250 msgr2=0x7f7970071620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:20.028 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:20.025+0000 7f7974c12700 1 --2- 172.21.15.57:0/1900079414 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7970071250 0x7f7970071620 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f79600097d0 tx=0x7f7960009ae0 comp rx=0 tx=0).stop 2023-03-03T07:47:20.029 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:20.025+0000 7f7974c12700 1 -- 172.21.15.57:0/1900079414 shutdown_connections 2023-03-03T07:47:20.029 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:20.025+0000 7f7974c12700 1 --2- 172.21.15.57:0/1900079414 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7970071250 0x7f7970071620 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:20.029 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:20.025+0000 7f7974c12700 1 -- 172.21.15.57:0/1900079414 >> 172.21.15.57:0/1900079414 conn(0x7f79700943e0 msgr2=0x7f7970095e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:47:20.029 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:20.025+0000 7f7974c12700 1 -- 172.21.15.57:0/1900079414 shutdown_connections 2023-03-03T07:47:20.029 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:20.025+0000 7f7974c12700 1 -- 172.21.15.57:0/1900079414 wait complete. 2023-03-03T07:47:20.030 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:20.025+0000 7f7974c12700 1 Processor -- start 2023-03-03T07:47:20.031 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:20.025+0000 7f7974c12700 1 -- start start 2023-03-03T07:47:20.032 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:20.029+0000 7f7974c12700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7970071250 0x7f7970128620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:20.032 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:20.029+0000 7f7974c12700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7970125880 con 0x7f7970071250 2023-03-03T07:47:20.032 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:20.029+0000 7f796f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7970071250 0x7f7970128620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:20.033 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:20.029+0000 7f796f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7970071250 0x7f7970128620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48160/0 (socket says 172.21.15.57:48160) 2023-03-03T07:47:20.033 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:20.029+0000 7f796f7fe700 1 -- 172.21.15.57:0/500675985 learned_addr learned my addr 172.21.15.57:0/500675985 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:47:20.034 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:20.029+0000 7f796f7fe700 1 -- 172.21.15.57:0/500675985 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79600094b0 con 0x7f7970071250 2023-03-03T07:47:20.034 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:20.029+0000 7f796f7fe700 1 --2- 172.21.15.57:0/500675985 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7970071250 0x7f7970128620 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f79600090b0 tx=0x7f7960004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:20.034 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:20.029+0000 7f796cff9700 1 -- 172.21.15.57:0/500675985 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7960003c80 con 0x7f7970071250 2023-03-03T07:47:20.035 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:20.029+0000 7f796cff9700 1 -- 172.21.15.57:0/500675985 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f796001f070 con 0x7f7970071250 2023-03-03T07:47:20.035 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:20.029+0000 7f796cff9700 1 -- 172.21.15.57:0/500675985 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7960011630 con 0x7f7970071250 2023-03-03T07:47:20.035 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:20.029+0000 7f7974c12700 1 -- 172.21.15.57:0/500675985 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f797008bc80 con 0x7f7970071250 2023-03-03T07:47:20.035 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:20.029+0000 7f7974c12700 1 -- 172.21.15.57:0/500675985 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f797008baf0 con 0x7f7970071250 2023-03-03T07:47:20.036 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:20.033+0000 7f796cff9700 1 -- 172.21.15.57:0/500675985 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 10) v1 ==== 42365+0+0 (secure 0 0 0) 0x7f796002a020 con 0x7f7970071250 2023-03-03T07:47:20.037 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:20.033+0000 7f7974c12700 1 -- 172.21.15.57:0/500675985 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f797008be10 con 0x7f7970071250 2023-03-03T07:47:20.037 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:20.033+0000 7f796cff9700 1 --2- 172.21.15.57:0/500675985 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f7950034950 0x7f7950036e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:20.037 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:20.033+0000 7f796cff9700 1 -- 172.21.15.57:0/500675985 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 2928+0+0 (secure 0 0 0) 0x7f7960047aa0 con 0x7f7970071250 2023-03-03T07:47:20.038 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:20.033+0000 7f7967fff700 1 --2- 172.21.15.57:0/500675985 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f7950034950 0x7f7950036e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:20.039 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:20.033+0000 7f7967fff700 1 --2- 172.21.15.57:0/500675985 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f7950034950 0x7f7950036e00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f79580016d0 tx=0x7f7958007a20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:20.044 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:20.041+0000 7f796cff9700 1 -- 172.21.15.57:0/500675985 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f79600117e0 con 0x7f7970071250 2023-03-03T07:47:20.281 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:20.277+0000 7f7974c12700 1 -- 172.21.15.57:0/500675985 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f79700619b0 con 0x7f7970071250 2023-03-03T07:47:20.281 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:20.277+0000 7f796cff9700 1 -- 172.21.15.57:0/500675985 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+280 (secure 0 0 0) 0x7f7960006ce0 con 0x7f7970071250 2023-03-03T07:47:20.446 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:20.441+0000 7f7974c12700 1 -- 172.21.15.57:0/500675985 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f79700619b0 con 0x7f7970071250 2023-03-03T07:47:20.447 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:20.441+0000 7f796cff9700 1 -- 172.21.15.57:0/500675985 <== mon.0 v2:172.21.15.57:3300/0 8 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+280 (secure 0 0 0) 0x7f7960023bc0 con 0x7f7970071250 2023-03-03T07:47:20.450 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:20.445+0000 7f7974c12700 1 -- 172.21.15.57:0/500675985 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f7950034950 msgr2=0x7f7950036e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:20.450 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:20.445+0000 7f7974c12700 1 --2- 172.21.15.57:0/500675985 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f7950034950 0x7f7950036e00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f79580016d0 tx=0x7f7958007a20 comp rx=0 tx=0).stop 2023-03-03T07:47:20.450 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:20.445+0000 7f7974c12700 1 -- 172.21.15.57:0/500675985 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7970071250 msgr2=0x7f7970128620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:20.450 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:20.445+0000 7f7974c12700 1 --2- 172.21.15.57:0/500675985 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7970071250 0x7f7970128620 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f79600090b0 tx=0x7f7960004770 comp rx=0 tx=0).stop 2023-03-03T07:47:20.451 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:20.445+0000 7f7974c12700 1 -- 172.21.15.57:0/500675985 shutdown_connections 2023-03-03T07:47:20.451 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:20.445+0000 7f7974c12700 1 --2- 172.21.15.57:0/500675985 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f7950034950 0x7f7950036e00 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:20.451 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:20.445+0000 7f7974c12700 1 --2- 172.21.15.57:0/500675985 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7970071250 0x7f7970128620 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:20.451 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:20.445+0000 7f7974c12700 1 -- 172.21.15.57:0/500675985 >> 172.21.15.57:0/500675985 conn(0x7f79700943e0 msgr2=0x7f797012b990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:47:20.451 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:20.445+0000 7f7974c12700 1 -- 172.21.15.57:0/500675985 shutdown_connections 2023-03-03T07:47:20.451 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:20.445+0000 7f7974c12700 1 -- 172.21.15.57:0/500675985 wait complete. 2023-03-03T07:47:20.478 INFO:tasks.workunit.client.0.smithi057.stderr:+ health='HEALTH_WARN 1 nearfull osd(s); 4 pool(s) nearfull 2023-03-03T07:47:20.478 INFO:tasks.workunit.client.0.smithi057.stderr:[WRN] OSD_NEARFULL: 1 nearfull osd(s) 2023-03-03T07:47:20.478 INFO:tasks.workunit.client.0.smithi057.stderr: osd.0 is near full 2023-03-03T07:47:20.479 INFO:tasks.workunit.client.0.smithi057.stderr:[WRN] POOL_NEARFULL: 4 pool(s) nearfull 2023-03-03T07:47:20.479 INFO:tasks.workunit.client.0.smithi057.stderr: pool '\''.mgr'\'' is nearfull 2023-03-03T07:47:20.479 INFO:tasks.workunit.client.0.smithi057.stderr: pool '\''rbd'\'' is nearfull 2023-03-03T07:47:20.479 INFO:tasks.workunit.client.0.smithi057.stderr: pool '\''cephfs_metadata'\'' is nearfull 2023-03-03T07:47:20.480 INFO:tasks.workunit.client.0.smithi057.stderr: pool '\''cephfs_data'\'' is nearfull' 2023-03-03T07:47:20.480 INFO:tasks.workunit.client.0.smithi057.stderr:+ [[ HEALTH_WARN 1 nearfull osd(s); 4 pool(s) nearfull 2023-03-03T07:47:20.480 INFO:tasks.workunit.client.0.smithi057.stderr:[WRN] OSD_NEARFULL: 1 nearfull osd(s) 2023-03-03T07:47:20.481 INFO:tasks.workunit.client.0.smithi057.stderr: osd.0 is near full 2023-03-03T07:47:20.481 INFO:tasks.workunit.client.0.smithi057.stderr:[WRN] POOL_NEARFULL: 4 pool(s) nearfull 2023-03-03T07:47:20.481 INFO:tasks.workunit.client.0.smithi057.stderr: pool '.mgr' is nearfull 2023-03-03T07:47:20.481 INFO:tasks.workunit.client.0.smithi057.stderr: pool 'rbd' is nearfull 2023-03-03T07:47:20.481 INFO:tasks.workunit.client.0.smithi057.stderr: pool 'cephfs_metadata' is nearfull 2023-03-03T07:47:20.481 INFO:tasks.workunit.client.0.smithi057.stderr: pool 'cephfs_data' is nearfull = *\O\S\D\_\F\U\L\L* ]] 2023-03-03T07:47:20.481 INFO:tasks.workunit.client.0.smithi057.stderr:+ echo 'Wating for osd to be full: 76' 2023-03-03T07:47:20.482 INFO:tasks.workunit.client.0.smithi057.stderr:+ sleep 1 2023-03-03T07:47:20.482 INFO:tasks.workunit.client.0.smithi057.stdout:Wating for osd to be full: 76 2023-03-03T07:47:21.353 INFO:tasks.ceph.mon.a.smithi057.stderr:2023-03-03T07:47:21.349+0000 7fcc0ddf9700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2023-03-03T07:47:21.485 INFO:tasks.workunit.client.0.smithi057.stderr:+ let timeout-=1 2023-03-03T07:47:21.485 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 75 -gt 0 ']' 2023-03-03T07:47:21.487 INFO:tasks.workunit.client.0.smithi057.stderr:++ ceph health detail 2023-03-03T07:47:21.653 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:21.649+0000 7f5305616700 1 Processor -- start 2023-03-03T07:47:21.654 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:21.649+0000 7f5305616700 1 -- start start 2023-03-03T07:47:21.655 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:21.653+0000 7f5305616700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5300090630 0x7f5300090a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:21.656 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:21.653+0000 7f5305616700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53000915e0 con 0x7f5300090f40 2023-03-03T07:47:21.656 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:21.653+0000 7f5305616700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f530006ef70 con 0x7f5300090630 2023-03-03T07:47:21.657 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:21.653+0000 7f52feffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5300090630 0x7f5300090a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:21.657 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:21.653+0000 7f52fe7fc700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f5300090f40 0x7f53001276e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37616/0 (socket says 172.21.15.57:37616) 2023-03-03T07:47:21.657 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:21.653+0000 7f52fe7fc700 1 -- 172.21.15.57:0/2695638089 learned_addr learned my addr 172.21.15.57:0/2695638089 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:47:21.657 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:21.653+0000 7f52feffd700 1 -- 172.21.15.57:0/2695638089 >> v1:172.21.15.57:6789/0 conn(0x7f5300090f40 legacy=0x7f53001276e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:21.658 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:21.653+0000 7f52feffd700 1 -- 172.21.15.57:0/2695638089 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f530006d080 con 0x7f5300090630 2023-03-03T07:47:21.658 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:21.653+0000 7f52feffd700 1 --2- 172.21.15.57:0/2695638089 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5300090630 0x7f5300090a00 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f52f00097d0 tx=0x7f52f0009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34d8249b6136e0f4 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:21.659 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:21.653+0000 7f52fdffb700 1 -- 172.21.15.57:0/2695638089 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f52f0004160 con 0x7f5300090630 2023-03-03T07:47:21.659 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:21.653+0000 7f52fdffb700 1 -- 172.21.15.57:0/2695638089 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52f00042c0 con 0x7f5300090630 2023-03-03T07:47:21.659 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:21.653+0000 7f52fdffb700 1 -- 172.21.15.57:0/2695638089 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f52f0004580 con 0x7f5300090630 2023-03-03T07:47:21.659 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:21.657+0000 7f5305616700 1 -- 172.21.15.57:0/2695638089 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5300090630 msgr2=0x7f5300090a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:21.660 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:21.657+0000 7f5305616700 1 --2- 172.21.15.57:0/2695638089 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5300090630 0x7f5300090a00 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f52f00097d0 tx=0x7f52f0009ae0 comp rx=0 tx=0).stop 2023-03-03T07:47:21.660 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:21.657+0000 7f5305616700 1 -- 172.21.15.57:0/2695638089 shutdown_connections 2023-03-03T07:47:21.660 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:21.657+0000 7f5305616700 1 --2- 172.21.15.57:0/2695638089 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5300090630 0x7f5300090a00 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:21.661 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:21.657+0000 7f5305616700 1 -- 172.21.15.57:0/2695638089 >> 172.21.15.57:0/2695638089 conn(0x7f53000703a0 msgr2=0x7f53000707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:47:21.661 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:21.657+0000 7f5305616700 1 -- 172.21.15.57:0/2695638089 shutdown_connections 2023-03-03T07:47:21.661 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:21.657+0000 7f5305616700 1 -- 172.21.15.57:0/2695638089 wait complete. 2023-03-03T07:47:21.663 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:21.657+0000 7f5305616700 1 Processor -- start 2023-03-03T07:47:21.663 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:21.661+0000 7f5305616700 1 -- start start 2023-03-03T07:47:21.664 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:21.661+0000 7f5305616700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5300090630 0x7f53001bc050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:21.664 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:21.661+0000 7f5305616700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f530011f470 con 0x7f5300090630 2023-03-03T07:47:21.665 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:21.661+0000 7f52feffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5300090630 0x7f53001bc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:21.665 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:21.661+0000 7f52feffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5300090630 0x7f53001bc050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48186/0 (socket says 172.21.15.57:48186) 2023-03-03T07:47:21.665 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:21.661+0000 7f52feffd700 1 -- 172.21.15.57:0/3935618161 learned_addr learned my addr 172.21.15.57:0/3935618161 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:47:21.665 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:21.661+0000 7f52feffd700 1 -- 172.21.15.57:0/3935618161 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f00094b0 con 0x7f5300090630 2023-03-03T07:47:21.666 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:21.661+0000 7f52feffd700 1 --2- 172.21.15.57:0/3935618161 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5300090630 0x7f53001bc050 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f52f0000c00 tx=0x7f52f0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:21.666 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:21.661+0000 7f52e77fe700 1 -- 172.21.15.57:0/3935618161 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f52f0011630 con 0x7f5300090630 2023-03-03T07:47:21.667 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:21.661+0000 7f52e77fe700 1 -- 172.21.15.57:0/3935618161 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52f0011790 con 0x7f5300090630 2023-03-03T07:47:21.667 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:21.661+0000 7f52e77fe700 1 -- 172.21.15.57:0/3935618161 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f52f0011a70 con 0x7f5300090630 2023-03-03T07:47:21.667 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:21.661+0000 7f5305616700 1 -- 172.21.15.57:0/3935618161 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5300128190 con 0x7f5300090630 2023-03-03T07:47:21.667 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:21.661+0000 7f5305616700 1 -- 172.21.15.57:0/3935618161 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5300128000 con 0x7f5300090630 2023-03-03T07:47:21.668 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:21.665+0000 7f52e77fe700 1 -- 172.21.15.57:0/3935618161 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 10) v1 ==== 42365+0+0 (secure 0 0 0) 0x7f52f002e070 con 0x7f5300090630 2023-03-03T07:47:21.669 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:21.665+0000 7f5305616700 1 -- 172.21.15.57:0/3935618161 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5300128320 con 0x7f5300090630 2023-03-03T07:47:21.669 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:21.665+0000 7f52e77fe700 1 --2- 172.21.15.57:0/3935618161 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f52ec034960 0x7f52ec036e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:21.669 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:21.665+0000 7f52e77fe700 1 -- 172.21.15.57:0/3935618161 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 2928+0+0 (secure 0 0 0) 0x7f52f0047770 con 0x7f5300090630 2023-03-03T07:47:21.670 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:21.665+0000 7f52e77fe700 1 -- 172.21.15.57:0/3935618161 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=38}) v3 -- 0x7f52ec03b200 con 0x7f5300090630 2023-03-03T07:47:21.670 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:21.665+0000 7f52fe7fc700 1 --2- 172.21.15.57:0/3935618161 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f52ec034960 0x7f52ec036e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:21.671 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:21.665+0000 7f52fe7fc700 1 --2- 172.21.15.57:0/3935618161 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f52ec034960 0x7f52ec036e10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f52f4001800 tx=0x7f52f4007af0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:21.676 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:21.673+0000 7f52e77fe700 1 -- 172.21.15.57:0/3935618161 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f52f0016020 con 0x7f5300090630 2023-03-03T07:47:21.921 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:21.917+0000 7f5305616700 1 -- 172.21.15.57:0/3935618161 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f53000619b0 con 0x7f5300090630 2023-03-03T07:47:21.921 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:21.917+0000 7f52e77fe700 1 -- 172.21.15.57:0/3935618161 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+278 (secure 0 0 0) 0x7f52f0016030 con 0x7f5300090630 2023-03-03T07:47:22.078 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.073+0000 7f5305616700 1 -- 172.21.15.57:0/3935618161 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f53000619b0 con 0x7f5300090630 2023-03-03T07:47:22.079 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.073+0000 7f52e77fe700 1 -- 172.21.15.57:0/3935618161 <== mon.0 v2:172.21.15.57:3300/0 8 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+278 (secure 0 0 0) 0x7f52f0016030 con 0x7f5300090630 2023-03-03T07:47:22.082 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.077+0000 7f5305616700 1 -- 172.21.15.57:0/3935618161 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f52ec034960 msgr2=0x7f52ec036e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:22.082 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.077+0000 7f5305616700 1 --2- 172.21.15.57:0/3935618161 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f52ec034960 0x7f52ec036e10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f52f4001800 tx=0x7f52f4007af0 comp rx=0 tx=0).stop 2023-03-03T07:47:22.082 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.077+0000 7f5305616700 1 -- 172.21.15.57:0/3935618161 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5300090630 msgr2=0x7f53001bc050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:22.082 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.077+0000 7f5305616700 1 --2- 172.21.15.57:0/3935618161 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5300090630 0x7f53001bc050 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f52f0000c00 tx=0x7f52f0004770 comp rx=0 tx=0).stop 2023-03-03T07:47:22.083 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.077+0000 7f5305616700 1 -- 172.21.15.57:0/3935618161 shutdown_connections 2023-03-03T07:47:22.083 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.077+0000 7f5305616700 1 --2- 172.21.15.57:0/3935618161 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f52ec034960 0x7f52ec036e10 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:22.083 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.077+0000 7f5305616700 1 --2- 172.21.15.57:0/3935618161 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5300090630 0x7f53001bc050 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:22.083 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.077+0000 7f5305616700 1 -- 172.21.15.57:0/3935618161 >> 172.21.15.57:0/3935618161 conn(0x7f53000703a0 msgr2=0x7f530008a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:47:22.084 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.077+0000 7f5305616700 1 -- 172.21.15.57:0/3935618161 shutdown_connections 2023-03-03T07:47:22.084 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.077+0000 7f5305616700 1 -- 172.21.15.57:0/3935618161 wait complete. 2023-03-03T07:47:22.108 INFO:tasks.workunit.client.0.smithi057.stderr:+ health='HEALTH_ERR 1 full osd(s); 4 pool(s) full 2023-03-03T07:47:22.109 INFO:tasks.workunit.client.0.smithi057.stderr:[ERR] OSD_FULL: 1 full osd(s) 2023-03-03T07:47:22.109 INFO:tasks.workunit.client.0.smithi057.stderr: osd.0 is full 2023-03-03T07:47:22.109 INFO:tasks.workunit.client.0.smithi057.stderr:[WRN] POOL_FULL: 4 pool(s) full 2023-03-03T07:47:22.109 INFO:tasks.workunit.client.0.smithi057.stderr: pool '\''.mgr'\'' is full (no space) 2023-03-03T07:47:22.109 INFO:tasks.workunit.client.0.smithi057.stderr: pool '\''rbd'\'' is full (no space) 2023-03-03T07:47:22.109 INFO:tasks.workunit.client.0.smithi057.stderr: pool '\''cephfs_metadata'\'' is full (no space) 2023-03-03T07:47:22.110 INFO:tasks.workunit.client.0.smithi057.stderr: pool '\''cephfs_data'\'' is full (no space)' 2023-03-03T07:47:22.110 INFO:tasks.workunit.client.0.smithi057.stderr:+ [[ HEALTH_ERR 1 full osd(s); 4 pool(s) full 2023-03-03T07:47:22.110 INFO:tasks.workunit.client.0.smithi057.stderr:[ERR] OSD_FULL: 1 full osd(s) 2023-03-03T07:47:22.110 INFO:tasks.workunit.client.0.smithi057.stderr: osd.0 is full 2023-03-03T07:47:22.110 INFO:tasks.workunit.client.0.smithi057.stderr:[WRN] POOL_FULL: 4 pool(s) full 2023-03-03T07:47:22.110 INFO:tasks.workunit.client.0.smithi057.stderr: pool '.mgr' is full (no space) 2023-03-03T07:47:22.110 INFO:tasks.workunit.client.0.smithi057.stderr: pool 'rbd' is full (no space) 2023-03-03T07:47:22.111 INFO:tasks.workunit.client.0.smithi057.stderr: pool 'cephfs_metadata' is full (no space) 2023-03-03T07:47:22.111 INFO:tasks.workunit.client.0.smithi057.stderr: pool 'cephfs_data' is full (no space) = *\O\S\D\_\F\U\L\L* ]] 2023-03-03T07:47:22.111 INFO:tasks.workunit.client.0.smithi057.stderr:+ echo 'OSD is full' 2023-03-03T07:47:22.111 INFO:tasks.workunit.client.0.smithi057.stdout:OSD is full 2023-03-03T07:47:22.112 INFO:tasks.workunit.client.0.smithi057.stderr:+ break 2023-03-03T07:47:22.112 INFO:tasks.workunit.client.0.smithi057.stdout:After osd is full 2023-03-03T07:47:22.112 INFO:tasks.workunit.client.0.smithi057.stderr:+ echo 'After osd is full' 2023-03-03T07:47:22.112 INFO:tasks.workunit.client.0.smithi057.stderr:+ df -h /home/ubuntu/cephtest/mnt.0 2023-03-03T07:47:22.119 INFO:tasks.workunit.client.0.smithi057.stdout:Filesystem Size Used Avail Use% Mounted on 2023-03-03T07:47:22.119 INFO:tasks.workunit.client.0.smithi057.stdout:ceph-fuse 700M 700M 0 100% /home/ubuntu/cephtest/mnt.0 2023-03-03T07:47:22.120 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph osd df 2023-03-03T07:47:22.280 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.277+0000 7f3d80bce700 1 Processor -- start 2023-03-03T07:47:22.281 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.277+0000 7f3d80bce700 1 -- start start 2023-03-03T07:47:22.282 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.277+0000 7f3d80bce700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3d7c125870 0x7f3d7c125c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:22.282 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.277+0000 7f3d80bce700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d7c070380 con 0x7f3d7c06e1b0 2023-03-03T07:47:22.282 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.277+0000 7f3d80bce700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d7c070690 con 0x7f3d7c125870 2023-03-03T07:47:22.283 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.277+0000 7f3d7b7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3d7c125870 0x7f3d7c125c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:22.283 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.277+0000 7f3d7affd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f3d7c06e1b0 0x7f3d7c06e630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37620/0 (socket says 172.21.15.57:37620) 2023-03-03T07:47:22.283 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.277+0000 7f3d7affd700 1 -- 172.21.15.57:0/1762270203 learned_addr learned my addr 172.21.15.57:0/1762270203 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:47:22.284 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.281+0000 7f3d7b7fe700 1 -- 172.21.15.57:0/1762270203 >> v1:172.21.15.57:6789/0 conn(0x7f3d7c06e1b0 legacy=0x7f3d7c06e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:22.284 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.281+0000 7f3d7b7fe700 1 -- 172.21.15.57:0/1762270203 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d7c126180 con 0x7f3d7c125870 2023-03-03T07:47:22.284 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.281+0000 7f3d7a7fc700 1 -- 172.21.15.57:0/1762270203 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4260035063 0 0) 0x7f3d7c070380 con 0x7f3d7c06e1b0 2023-03-03T07:47:22.285 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.281+0000 7f3d7b7fe700 1 --2- 172.21.15.57:0/1762270203 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d7c125870 0x7f3d7c125c40 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c0097d0 tx=0x7f3d6c009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5604432d0bce90b server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:22.285 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.281+0000 7f3d7a7fc700 1 -- 172.21.15.57:0/1762270203 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d6c0041c0 con 0x7f3d7c125870 2023-03-03T07:47:22.286 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.281+0000 7f3d7a7fc700 1 -- 172.21.15.57:0/1762270203 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d6c004320 con 0x7f3d7c125870 2023-03-03T07:47:22.286 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.281+0000 7f3d7a7fc700 1 -- 172.21.15.57:0/1762270203 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d6c0036c0 con 0x7f3d7c125870 2023-03-03T07:47:22.286 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.281+0000 7f3d80bce700 1 -- 172.21.15.57:0/1762270203 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d7c125870 msgr2=0x7f3d7c125c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:22.287 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.281+0000 7f3d80bce700 1 --2- 172.21.15.57:0/1762270203 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d7c125870 0x7f3d7c125c40 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c0097d0 tx=0x7f3d6c009ae0 comp rx=0 tx=0).stop 2023-03-03T07:47:22.287 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.281+0000 7f3d80bce700 1 -- 172.21.15.57:0/1762270203 shutdown_connections 2023-03-03T07:47:22.287 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.281+0000 7f3d80bce700 1 --2- 172.21.15.57:0/1762270203 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d7c125870 0x7f3d7c125c40 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:22.287 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.281+0000 7f3d80bce700 1 -- 172.21.15.57:0/1762270203 >> 172.21.15.57:0/1762270203 conn(0x7f3d7c0943e0 msgr2=0x7f3d7c095e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:47:22.287 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.281+0000 7f3d80bce700 1 -- 172.21.15.57:0/1762270203 shutdown_connections 2023-03-03T07:47:22.287 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.281+0000 7f3d80bce700 1 -- 172.21.15.57:0/1762270203 wait complete. 2023-03-03T07:47:22.289 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.285+0000 7f3d80bce700 1 Processor -- start 2023-03-03T07:47:22.290 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.285+0000 7f3d80bce700 1 -- start start 2023-03-03T07:47:22.291 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.285+0000 7f3d80bce700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d7c06e1b0 0x7f3d7c1bbe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:22.291 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.285+0000 7f3d80bce700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d7c08d260 con 0x7f3d7c06e1b0 2023-03-03T07:47:22.291 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.289+0000 7f3d7b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d7c06e1b0 0x7f3d7c1bbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:22.292 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.289+0000 7f3d7b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d7c06e1b0 0x7f3d7c1bbe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48200/0 (socket says 172.21.15.57:48200) 2023-03-03T07:47:22.292 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.289+0000 7f3d7b7fe700 1 -- 172.21.15.57:0/2096949912 learned_addr learned my addr 172.21.15.57:0/2096949912 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:47:22.292 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.289+0000 7f3d7b7fe700 1 -- 172.21.15.57:0/2096949912 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d6c0094b0 con 0x7f3d7c06e1b0 2023-03-03T07:47:22.293 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.289+0000 7f3d7b7fe700 1 --2- 172.21.15.57:0/2096949912 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d7c06e1b0 0x7f3d7c1bbe40 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c009b20 tx=0x7f3d6c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:22.295 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.289+0000 7f3d63fff700 1 -- 172.21.15.57:0/2096949912 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d6c003de0 con 0x7f3d7c06e1b0 2023-03-03T07:47:22.295 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.289+0000 7f3d63fff700 1 -- 172.21.15.57:0/2096949912 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d6c011630 con 0x7f3d7c06e1b0 2023-03-03T07:47:22.295 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.289+0000 7f3d80bce700 1 -- 172.21.15.57:0/2096949912 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d7c12d880 con 0x7f3d7c06e1b0 2023-03-03T07:47:22.295 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.289+0000 7f3d63fff700 1 -- 172.21.15.57:0/2096949912 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d6c011910 con 0x7f3d7c06e1b0 2023-03-03T07:47:22.295 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.289+0000 7f3d80bce700 1 -- 172.21.15.57:0/2096949912 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d7c06ef50 con 0x7f3d7c06e1b0 2023-03-03T07:47:22.296 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.293+0000 7f3d63fff700 1 -- 172.21.15.57:0/2096949912 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 10) v1 ==== 42365+0+0 (secure 0 0 0) 0x7f3d6c02e070 con 0x7f3d7c06e1b0 2023-03-03T07:47:22.296 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.293+0000 7f3d80bce700 1 -- 172.21.15.57:0/2096949912 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d7c12da10 con 0x7f3d7c06e1b0 2023-03-03T07:47:22.297 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.293+0000 7f3d63fff700 1 --2- 172.21.15.57:0/2096949912 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f3d68034960 0x7f3d68036e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:22.297 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.293+0000 7f3d63fff700 1 -- 172.21.15.57:0/2096949912 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 2928+0+0 (secure 0 0 0) 0x7f3d6c0477e0 con 0x7f3d7c06e1b0 2023-03-03T07:47:22.298 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.293+0000 7f3d63fff700 1 -- 172.21.15.57:0/2096949912 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=38}) v3 -- 0x7f3d6803b200 con 0x7f3d7c06e1b0 2023-03-03T07:47:22.298 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.293+0000 7f3d7affd700 1 --2- 172.21.15.57:0/2096949912 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f3d68034960 0x7f3d68036e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:22.299 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.297+0000 7f3d7affd700 1 --2- 172.21.15.57:0/2096949912 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f3d68034960 0x7f3d68036e10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3d700011e0 tx=0x7f3d700079e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:22.306 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.301+0000 7f3d63fff700 1 -- 172.21.15.57:0/2096949912 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f3d6c016020 con 0x7f3d7c06e1b0 2023-03-03T07:47:22.482 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.477+0000 7f3d80bce700 1 -- 172.21.15.57:0/2096949912 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 0: {"prefix": "osd df", "target": ["mon-mgr", ""]}) v1 -- 0x7f3d7c04e230 con 0x7f3d68034960 2023-03-03T07:47:22.483 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.477+0000 7f3d63fff700 1 -- 172.21.15.57:0/2096949912 <== mgr.4099 v2:172.21.15.57:6808/28565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+343 (secure 0 0 0) 0x7f3d7c04e230 con 0x7f3d68034960 2023-03-03T07:47:22.578 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.573+0000 7f3d80bce700 1 -- 172.21.15.57:0/2096949912 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 1: {"prefix": "osd df", "target": ["mon-mgr", ""]}) v1 -- 0x7f3d7c08e4f0 con 0x7f3d68034960 2023-03-03T07:47:22.579 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.573+0000 7f3d63fff700 1 -- 172.21.15.57:0/2096949912 <== mgr.4099 v2:172.21.15.57:6808/28565 2 ==== mgr_command_reply(tid 1: 0 ) v1 ==== 8+0+343 (secure 0 0 0) 0x7f3d70004890 con 0x7f3d68034960 2023-03-03T07:47:22.579 INFO:tasks.workunit.client.0.smithi057.stdout:ID CLASS WEIGHT REWEIGHT SIZE RAW USE DATA OMAP META AVAIL %USE VAR PGS STATUS 2023-03-03T07:47:22.580 INFO:tasks.workunit.client.0.smithi057.stdout: 0 ssd 0.00099 1.00000 1 GiB 648 MiB 623 MiB 0 B 24 MiB 376 MiB 63.25 1.00 105 up 2023-03-03T07:47:22.580 INFO:tasks.workunit.client.0.smithi057.stdout: TOTAL 1 GiB 648 MiB 623 MiB 0 B 24 MiB 376 MiB 63.25 2023-03-03T07:47:22.580 INFO:tasks.workunit.client.0.smithi057.stdout:MIN/MAX VAR: 1.00/1.00 STDDEV: 0 2023-03-03T07:47:22.582 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.577+0000 7f3d80bce700 1 -- 172.21.15.57:0/2096949912 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f3d68034960 msgr2=0x7f3d68036e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:22.582 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.577+0000 7f3d80bce700 1 --2- 172.21.15.57:0/2096949912 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f3d68034960 0x7f3d68036e10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3d700011e0 tx=0x7f3d700079e0 comp rx=0 tx=0).stop 2023-03-03T07:47:22.582 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.577+0000 7f3d80bce700 1 -- 172.21.15.57:0/2096949912 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d7c06e1b0 msgr2=0x7f3d7c1bbe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:22.583 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.577+0000 7f3d80bce700 1 --2- 172.21.15.57:0/2096949912 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d7c06e1b0 0x7f3d7c1bbe40 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c009b20 tx=0x7f3d6c004770 comp rx=0 tx=0).stop 2023-03-03T07:47:22.583 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.577+0000 7f3d80bce700 1 -- 172.21.15.57:0/2096949912 shutdown_connections 2023-03-03T07:47:22.583 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.577+0000 7f3d80bce700 1 --2- 172.21.15.57:0/2096949912 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f3d68034960 0x7f3d68036e10 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:22.584 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.577+0000 7f3d80bce700 1 --2- 172.21.15.57:0/2096949912 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d7c06e1b0 0x7f3d7c1bbe40 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:22.584 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.577+0000 7f3d80bce700 1 -- 172.21.15.57:0/2096949912 >> 172.21.15.57:0/2096949912 conn(0x7f3d7c0943e0 msgr2=0x7f3d7c090710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:47:22.584 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.577+0000 7f3d80bce700 1 -- 172.21.15.57:0/2096949912 shutdown_connections 2023-03-03T07:47:22.584 INFO:tasks.workunit.client.0.smithi057.stderr:2023-03-03T07:47:22.577+0000 7f3d80bce700 1 -- 172.21.15.57:0/2096949912 wait complete. 2023-03-03T07:47:22.612 INFO:tasks.workunit.client.0.smithi057.stderr:++ eval echo '{1..10}' 2023-03-03T07:47:22.612 INFO:tasks.workunit.client.0.smithi057.stderr:+++ echo 1 2 3 4 5 6 7 8 9 10 2023-03-03T07:47:22.614 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in $(eval echo {1..$NUM_CLONES}) 2023-03-03T07:47:22.614 INFO:tasks.workunit.client.0.smithi057.stderr:+ ignore_failure ceph fs clone status cephfs clone_1 2023-03-03T07:47:25.286 INFO:tasks.workunit.client.0.smithi057.stderr:+ cat /tmp/error__file 2023-03-03T07:47:25.293 INFO:tasks.workunit.client.0.smithi057.stdout:+ ceph fs clone status cephfs clone_1 2023-03-03T07:47:25.294 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:22.777+0000 7ff9c1328700 1 Processor -- start 2023-03-03T07:47:25.294 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:22.777+0000 7ff9c1328700 1 -- start start 2023-03-03T07:47:25.294 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:22.777+0000 7ff9c1328700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff9bc070e00 0x7ff9bc0711d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:25.294 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:22.777+0000 7ff9c1328700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9bc08f9c0 con 0x7ff9bc08e3b0 2023-03-03T07:47:25.294 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:22.777+0000 7ff9c1328700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9bc071710 con 0x7ff9bc070e00 2023-03-03T07:47:25.294 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:22.777+0000 7ff9bb7fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ff9bc08e3b0 0x7ff9bc08e7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37622/0 (socket says 172.21.15.57:37622) 2023-03-03T07:47:25.294 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:22.777+0000 7ff9bb7fe700 1 -- 172.21.15.57:0/3970272794 learned_addr learned my addr 172.21.15.57:0/3970272794 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:47:25.295 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:22.777+0000 7ff9bbfff700 1 --2- 172.21.15.57:0/3970272794 >> v2:172.21.15.57:3300/0 conn(0x7ff9bc070e00 0x7ff9bc0711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:25.295 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:22.777+0000 7ff9baffd700 1 -- 172.21.15.57:0/3970272794 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3358120800 0 0) 0x7ff9bc08f9c0 con 0x7ff9bc08e3b0 2023-03-03T07:47:25.295 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:22.777+0000 7ff9baffd700 1 -- 172.21.15.57:0/3970272794 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9a80035d0 con 0x7ff9bc08e3b0 2023-03-03T07:47:25.295 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:22.777+0000 7ff9baffd700 1 -- 172.21.15.57:0/3970272794 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1735074115 0 0) 0x7ff9a80035d0 con 0x7ff9bc08e3b0 2023-03-03T07:47:25.295 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:22.777+0000 7ff9bbfff700 1 -- 172.21.15.57:0/3970272794 >> v1:172.21.15.57:6789/0 conn(0x7ff9bc08e3b0 legacy=0x7ff9bc08e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:25.296 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:22.777+0000 7ff9bbfff700 1 -- 172.21.15.57:0/3970272794 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9bc08fcd0 con 0x7ff9bc070e00 2023-03-03T07:47:25.296 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:22.781+0000 7ff9bbfff700 1 --2- 172.21.15.57:0/3970272794 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9bc070e00 0x7ff9bc0711d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac009d90 tx=0x7ff9ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54ae071f87f48b10 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:25.296 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:22.781+0000 7ff9baffd700 1 -- 172.21.15.57:0/3970272794 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff9ac00e070 con 0x7ff9bc070e00 2023-03-03T07:47:25.296 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:22.781+0000 7ff9baffd700 1 -- 172.21.15.57:0/3970272794 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9ac003a40 con 0x7ff9bc070e00 2023-03-03T07:47:25.296 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:22.781+0000 7ff9baffd700 1 -- 172.21.15.57:0/3970272794 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff9b00015a0 con 0x7ff9bc070e00 2023-03-03T07:47:25.296 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:22.781+0000 7ff9c1328700 1 -- 172.21.15.57:0/3970272794 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9bc070e00 msgr2=0x7ff9bc0711d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:25.297 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:22.781+0000 7ff9c1328700 1 --2- 172.21.15.57:0/3970272794 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9bc070e00 0x7ff9bc0711d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac009d90 tx=0x7ff9ac00b330 comp rx=0 tx=0).stop 2023-03-03T07:47:25.297 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:22.781+0000 7ff9c1328700 1 -- 172.21.15.57:0/3970272794 shutdown_connections 2023-03-03T07:47:25.297 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:22.781+0000 7ff9c1328700 1 --2- 172.21.15.57:0/3970272794 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9bc070e00 0x7ff9bc0711d0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:25.297 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:22.781+0000 7ff9c1328700 1 -- 172.21.15.57:0/3970272794 >> 172.21.15.57:0/3970272794 conn(0x7ff9bc0948c0 msgr2=0x7ff9bc096cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:47:25.298 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:22.781+0000 7ff9c1328700 1 -- 172.21.15.57:0/3970272794 shutdown_connections 2023-03-03T07:47:25.298 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:22.781+0000 7ff9c1328700 1 -- 172.21.15.57:0/3970272794 wait complete. 2023-03-03T07:47:25.298 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:22.785+0000 7ff9c1328700 1 Processor -- start 2023-03-03T07:47:25.298 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:22.785+0000 7ff9c1328700 1 -- start start 2023-03-03T07:47:25.298 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:22.785+0000 7ff9c1328700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9bc070e00 0x7ff9bc129bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:25.298 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:22.785+0000 7ff9c1328700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9bc12c6a0 con 0x7ff9bc070e00 2023-03-03T07:47:25.298 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:22.789+0000 7ff9bbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9bc070e00 0x7ff9bc129bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:25.298 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:22.789+0000 7ff9bbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9bc070e00 0x7ff9bc129bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48224/0 (socket says 172.21.15.57:48224) 2023-03-03T07:47:25.299 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:22.789+0000 7ff9bbfff700 1 -- 172.21.15.57:0/3629512570 learned_addr learned my addr 172.21.15.57:0/3629512570 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:47:25.299 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:22.789+0000 7ff9bbfff700 1 -- 172.21.15.57:0/3629512570 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ac009a70 con 0x7ff9bc070e00 2023-03-03T07:47:25.299 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:22.789+0000 7ff9bbfff700 1 --2- 172.21.15.57:0/3629512570 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9bc070e00 0x7ff9bc129bf0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc071850 tx=0x7ff9ac004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:25.299 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:22.789+0000 7ff9b8ff9700 1 -- 172.21.15.57:0/3629512570 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff9ac00be40 con 0x7ff9bc070e00 2023-03-03T07:47:25.299 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:22.789+0000 7ff9b8ff9700 1 -- 172.21.15.57:0/3629512570 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9ac0046d0 con 0x7ff9bc070e00 2023-03-03T07:47:25.299 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:22.789+0000 7ff9c1328700 1 -- 172.21.15.57:0/3629512570 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9bc12d9a0 con 0x7ff9bc070e00 2023-03-03T07:47:25.299 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:22.789+0000 7ff9b8ff9700 1 -- 172.21.15.57:0/3629512570 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff9ac012430 con 0x7ff9bc070e00 2023-03-03T07:47:25.300 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:22.789+0000 7ff9c1328700 1 -- 172.21.15.57:0/3629512570 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9bc08f140 con 0x7ff9bc070e00 2023-03-03T07:47:25.300 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:22.789+0000 7ff9b8ff9700 1 -- 172.21.15.57:0/3629512570 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 10) v1 ==== 42365+0+0 (secure 0 0 0) 0x7ff9ac012590 con 0x7ff9bc070e00 2023-03-03T07:47:25.300 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:22.793+0000 7ff9c1328700 1 -- 172.21.15.57:0/3629512570 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9bc12db30 con 0x7ff9bc070e00 2023-03-03T07:47:25.300 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:22.793+0000 7ff9b8ff9700 1 --2- 172.21.15.57:0/3629512570 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7ff99c034950 0x7ff99c036e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:25.300 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:22.793+0000 7ff9b8ff9700 1 -- 172.21.15.57:0/3629512570 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 2928+0+0 (secure 0 0 0) 0x7ff9ac048670 con 0x7ff9bc070e00 2023-03-03T07:47:25.301 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:22.793+0000 7ff9bb7fe700 1 --2- 172.21.15.57:0/3629512570 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7ff99c034950 0x7ff99c036e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:25.301 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:22.793+0000 7ff9b8ff9700 1 -- 172.21.15.57:0/3629512570 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=38}) v3 -- 0x7ff99c03b1f0 con 0x7ff9bc070e00 2023-03-03T07:47:25.301 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:22.793+0000 7ff9bb7fe700 1 --2- 172.21.15.57:0/3629512570 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7ff99c034950 0x7ff99c036e00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff9b00011e0 tx=0x7ff9b00012b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:25.301 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:22.801+0000 7ff9b8ff9700 1 -- 172.21.15.57:0/3629512570 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff9ac01d420 con 0x7ff9bc070e00 2023-03-03T07:47:25.301 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:23.021+0000 7ff9c1328700 1 -- 172.21.15.57:0/3629512570 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_1", "target": ["mon-mgr", ""]}) v1 -- 0x7ff9bc12c520 con 0x7ff99c034950 2023-03-03T07:47:25.301 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.105+0000 7ff9b8ff9700 1 -- 172.21.15.57:0/3629512570 <== mgr.4099 v2:172.21.15.57:6808/28565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+46 (secure 0 0 0) 0x7ff9b0004890 con 0x7ff99c034950 2023-03-03T07:47:25.301 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.241+0000 7ff9c1328700 1 -- 172.21.15.57:0/3629512570 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 1: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_1", "target": ["mon-mgr", ""]}) v1 -- 0x7ff9bc12ca20 con 0x7ff99c034950 2023-03-03T07:47:25.302 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.249+0000 7ff9b8ff9700 1 -- 172.21.15.57:0/3629512570 <== mgr.4099 v2:172.21.15.57:6808/28565 2 ==== mgr_command_reply(tid 1: 0 ) v1 ==== 8+0+46 (secure 0 0 0) 0x7ff9bc12ca20 con 0x7ff99c034950 2023-03-03T07:47:25.302 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.253+0000 7ff9c1328700 1 -- 172.21.15.57:0/3629512570 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7ff99c034950 msgr2=0x7ff99c036e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:25.302 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.253+0000 7ff9c1328700 1 --2- 172.21.15.57:0/3629512570 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7ff99c034950 0x7ff99c036e00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff9b00011e0 tx=0x7ff9b00012b0 comp rx=0 tx=0).stop 2023-03-03T07:47:25.302 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.253+0000 7ff9c1328700 1 -- 172.21.15.57:0/3629512570 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9bc070e00 msgr2=0x7ff9bc129bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:25.302 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.253+0000 7ff9c1328700 1 --2- 172.21.15.57:0/3629512570 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9bc070e00 0x7ff9bc129bf0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc071850 tx=0x7ff9ac004af0 comp rx=0 tx=0).stop 2023-03-03T07:47:25.302 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.253+0000 7ff9c1328700 1 -- 172.21.15.57:0/3629512570 shutdown_connections 2023-03-03T07:47:25.302 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.253+0000 7ff9c1328700 1 --2- 172.21.15.57:0/3629512570 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7ff99c034950 0x7ff99c036e00 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:25.302 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.253+0000 7ff9c1328700 1 --2- 172.21.15.57:0/3629512570 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9bc070e00 0x7ff9bc129bf0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:25.303 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.253+0000 7ff9c1328700 1 -- 172.21.15.57:0/3629512570 >> 172.21.15.57:0/3629512570 conn(0x7ff9bc0948c0 msgr2=0x7ff9bc06e870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:47:25.303 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.253+0000 7ff9c1328700 1 -- 172.21.15.57:0/3629512570 shutdown_connections 2023-03-03T07:47:25.303 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.253+0000 7ff9c1328700 1 -- 172.21.15.57:0/3629512570 wait complete. 2023-03-03T07:47:25.303 INFO:tasks.workunit.client.0.smithi057.stdout:+ return 0 2023-03-03T07:47:25.303 INFO:tasks.workunit.client.0.smithi057.stderr:+ grep complete /tmp/out__file 2023-03-03T07:47:25.304 INFO:tasks.workunit.client.0.smithi057.stdout: "state": "complete" 2023-03-03T07:47:25.304 INFO:tasks.workunit.client.0.smithi057.stdout:The clone_1 is completed 2023-03-03T07:47:25.304 INFO:tasks.workunit.client.0.smithi057.stderr:+ echo 'The clone_1 is completed' 2023-03-03T07:47:25.305 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in $(eval echo {1..$NUM_CLONES}) 2023-03-03T07:47:25.305 INFO:tasks.workunit.client.0.smithi057.stderr:+ ignore_failure ceph fs clone status cephfs clone_2 2023-03-03T07:47:25.908 INFO:tasks.workunit.client.0.smithi057.stderr:+ cat /tmp/error__file 2023-03-03T07:47:25.914 INFO:tasks.workunit.client.0.smithi057.stdout:+ ceph fs clone status cephfs clone_2 2023-03-03T07:47:25.914 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.473+0000 7f1d11709700 1 Processor -- start 2023-03-03T07:47:25.914 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.473+0000 7f1d11709700 1 -- start start 2023-03-03T07:47:25.915 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.473+0000 7f1d11709700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1d0c127ff0 0x7f1d0c090ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:25.915 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.473+0000 7f1d11709700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d0c0917f0 con 0x7f1d0c127c20 2023-03-03T07:47:25.915 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.473+0000 7f1d11709700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d0c091a10 con 0x7f1d0c127ff0 2023-03-03T07:47:25.915 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.473+0000 7f1d0bfff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f1d0c127c20 0x7f1d0c0903c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37630/0 (socket says 172.21.15.57:37630) 2023-03-03T07:47:25.915 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.473+0000 7f1d0bfff700 1 -- 172.21.15.57:0/156791788 learned_addr learned my addr 172.21.15.57:0/156791788 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:47:25.915 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.477+0000 7f1d0b7fe700 1 --2- 172.21.15.57:0/156791788 >> v2:172.21.15.57:3300/0 conn(0x7f1d0c127ff0 0x7f1d0c090ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:25.915 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.477+0000 7f1d0affd700 1 -- 172.21.15.57:0/156791788 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2613202265 0 0) 0x7f1d0c0917f0 con 0x7f1d0c127c20 2023-03-03T07:47:25.916 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.477+0000 7f1d0affd700 1 -- 172.21.15.57:0/156791788 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cf80035d0 con 0x7f1d0c127c20 2023-03-03T07:47:25.916 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.477+0000 7f1d0affd700 1 -- 172.21.15.57:0/156791788 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 631279840 0 0) 0x7f1cf80035d0 con 0x7f1d0c127c20 2023-03-03T07:47:25.916 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.477+0000 7f1d0affd700 1 -- 172.21.15.57:0/156791788 >> v2:172.21.15.57:3300/0 conn(0x7f1d0c127ff0 msgr2=0x7f1d0c090ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T07:47:25.916 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.477+0000 7f1d0affd700 1 --2- 172.21.15.57:0/156791788 >> v2:172.21.15.57:3300/0 conn(0x7f1d0c127ff0 0x7f1d0c090ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:25.916 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.477+0000 7f1d0affd700 1 -- 172.21.15.57:0/156791788 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d0c06b930 con 0x7f1d0c127c20 2023-03-03T07:47:25.916 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.477+0000 7f1d0affd700 1 -- 172.21.15.57:0/156791788 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (unknown 2779775165 0 0) 0x7f1cfc0015a0 con 0x7f1d0c127c20 2023-03-03T07:47:25.916 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.477+0000 7f1d0affd700 1 -- 172.21.15.57:0/156791788 >> v1:172.21.15.57:6789/0 conn(0x7f1d0c127c20 legacy=0x7f1d0c0903c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:25.916 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.477+0000 7f1d0affd700 1 --2- 172.21.15.57:0/156791788 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cf8003a20 0x7f1cf8003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:25.917 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.477+0000 7f1d0affd700 1 -- 172.21.15.57:0/156791788 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf8004410 con 0x7f1cf8003a20 2023-03-03T07:47:25.917 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.477+0000 7f1d0bfff700 1 --2- 172.21.15.57:0/156791788 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cf8003a20 0x7f1cf8003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:25.917 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.477+0000 7f1d0bfff700 1 -- 172.21.15.57:0/156791788 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf80035d0 con 0x7f1cf8003a20 2023-03-03T07:47:25.917 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.481+0000 7f1d0bfff700 1 --2- 172.21.15.57:0/156791788 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cf8003a20 0x7f1cf8003df0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc001dc0 tx=0x7f1cf80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78b2aeee532ff7a server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:25.917 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.481+0000 7f1d0affd700 1 -- 172.21.15.57:0/156791788 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1cfc012440 con 0x7f1cf8003a20 2023-03-03T07:47:25.917 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.481+0000 7f1d0affd700 1 -- 172.21.15.57:0/156791788 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cfc0125a0 con 0x7f1cf8003a20 2023-03-03T07:47:25.918 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.481+0000 7f1d0affd700 1 -- 172.21.15.57:0/156791788 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1cfc012880 con 0x7f1cf8003a20 2023-03-03T07:47:25.918 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.481+0000 7f1d11709700 1 -- 172.21.15.57:0/156791788 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cf8003a20 msgr2=0x7f1cf8003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:25.918 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.481+0000 7f1d11709700 1 --2- 172.21.15.57:0/156791788 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cf8003a20 0x7f1cf8003df0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc001dc0 tx=0x7f1cf80058a0 comp rx=0 tx=0).stop 2023-03-03T07:47:25.918 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.481+0000 7f1d11709700 1 -- 172.21.15.57:0/156791788 shutdown_connections 2023-03-03T07:47:25.918 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.481+0000 7f1d11709700 1 --2- 172.21.15.57:0/156791788 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cf8003a20 0x7f1cf8003df0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:25.918 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.481+0000 7f1d11709700 1 --2- 172.21.15.57:0/156791788 >> v2:172.21.15.57:3300/0 conn(0x7f1d0c127ff0 0x7f1d0c090ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:25.918 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.481+0000 7f1d11709700 1 -- 172.21.15.57:0/156791788 >> 172.21.15.57:0/156791788 conn(0x7f1d0c06f810 msgr2=0x7f1d0c06fc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:47:25.918 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.481+0000 7f1d11709700 1 -- 172.21.15.57:0/156791788 shutdown_connections 2023-03-03T07:47:25.919 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.481+0000 7f1d11709700 1 -- 172.21.15.57:0/156791788 wait complete. 2023-03-03T07:47:25.919 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.485+0000 7f1d11709700 1 Processor -- start 2023-03-03T07:47:25.919 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.485+0000 7f1d11709700 1 -- start start 2023-03-03T07:47:25.919 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.485+0000 7f1d11709700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cf8003a20 0x7f1d0c1261d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:25.919 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.485+0000 7f1d11709700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0c125240 con 0x7f1cf8003a20 2023-03-03T07:47:25.919 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.485+0000 7f1d0bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cf8003a20 0x7f1d0c1261d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:25.919 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.485+0000 7f1d0bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cf8003a20 0x7f1d0c1261d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48238/0 (socket says 172.21.15.57:48238) 2023-03-03T07:47:25.920 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.485+0000 7f1d0bfff700 1 -- 172.21.15.57:0/2004079253 learned_addr learned my addr 172.21.15.57:0/2004079253 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:47:25.920 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.489+0000 7f1d0bfff700 1 -- 172.21.15.57:0/2004079253 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d0c0911a0 con 0x7f1cf8003a20 2023-03-03T07:47:25.920 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.489+0000 7f1d0bfff700 1 --2- 172.21.15.57:0/2004079253 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cf8003a20 0x7f1d0c1261d0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c067350 tx=0x7f1cfc001d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:25.920 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.489+0000 7f1d08ff9700 1 -- 172.21.15.57:0/2004079253 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1cfc001740 con 0x7f1cf8003a20 2023-03-03T07:47:25.920 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.489+0000 7f1d08ff9700 1 -- 172.21.15.57:0/2004079253 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cfc0018a0 con 0x7f1cf8003a20 2023-03-03T07:47:25.920 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.489+0000 7f1d08ff9700 1 -- 172.21.15.57:0/2004079253 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1cfc0014c0 con 0x7f1cf8003a20 2023-03-03T07:47:25.920 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.489+0000 7f1d11709700 1 -- 172.21.15.57:0/2004079253 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d0c091010 con 0x7f1cf8003a20 2023-03-03T07:47:25.921 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.489+0000 7f1d11709700 1 -- 172.21.15.57:0/2004079253 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d0c12d930 con 0x7f1cf8003a20 2023-03-03T07:47:25.921 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.489+0000 7f1d08ff9700 1 -- 172.21.15.57:0/2004079253 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 10) v1 ==== 42365+0+0 (secure 0 0 0) 0x7f1cfc010070 con 0x7f1cf8003a20 2023-03-03T07:47:25.921 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.489+0000 7f1d11709700 1 -- 172.21.15.57:0/2004079253 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d0c1255c0 con 0x7f1cf8003a20 2023-03-03T07:47:25.921 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.493+0000 7f1d08ff9700 1 --2- 172.21.15.57:0/2004079253 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f1cec034960 0x7f1cec036e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:25.921 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.493+0000 7f1d08ff9700 1 -- 172.21.15.57:0/2004079253 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 2928+0+0 (secure 0 0 0) 0x7f1cfc047b70 con 0x7f1cf8003a20 2023-03-03T07:47:25.921 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.493+0000 7f1d08ff9700 1 -- 172.21.15.57:0/2004079253 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=38}) v3 -- 0x7f1cec03b200 con 0x7f1cf8003a20 2023-03-03T07:47:25.921 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.493+0000 7f1d0b7fe700 1 --2- 172.21.15.57:0/2004079253 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f1cec034960 0x7f1cec036e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:25.921 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.493+0000 7f1d0b7fe700 1 --2- 172.21.15.57:0/2004079253 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f1cec034960 0x7f1cec036e10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1d000099c0 tx=0x7f1d00009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:25.922 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.501+0000 7f1d08ff9700 1 -- 172.21.15.57:0/2004079253 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1cfc01b390 con 0x7f1cf8003a20 2023-03-03T07:47:25.922 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.713+0000 7f1d11709700 1 -- 172.21.15.57:0/2004079253 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f1d0c1250c0 con 0x7f1cec034960 2023-03-03T07:47:25.922 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.729+0000 7f1d08ff9700 1 -- 172.21.15.57:0/2004079253 <== mgr.4099 v2:172.21.15.57:6808/28565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+46 (secure 0 0 0) 0x7f1d00006c80 con 0x7f1cec034960 2023-03-03T07:47:25.922 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.861+0000 7f1d11709700 1 -- 172.21.15.57:0/2004079253 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 1: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f1d0c124e70 con 0x7f1cec034960 2023-03-03T07:47:25.922 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.873+0000 7f1d08ff9700 1 -- 172.21.15.57:0/2004079253 <== mgr.4099 v2:172.21.15.57:6808/28565 2 ==== mgr_command_reply(tid 1: 0 ) v1 ==== 8+0+46 (secure 0 0 0) 0x7f1d0c124e70 con 0x7f1cec034960 2023-03-03T07:47:25.922 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.877+0000 7f1d11709700 1 -- 172.21.15.57:0/2004079253 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f1cec034960 msgr2=0x7f1cec036e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:25.922 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.877+0000 7f1d11709700 1 --2- 172.21.15.57:0/2004079253 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f1cec034960 0x7f1cec036e10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1d000099c0 tx=0x7f1d00009240 comp rx=0 tx=0).stop 2023-03-03T07:47:25.923 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.877+0000 7f1d11709700 1 -- 172.21.15.57:0/2004079253 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cf8003a20 msgr2=0x7f1d0c1261d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:25.923 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.877+0000 7f1d11709700 1 --2- 172.21.15.57:0/2004079253 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cf8003a20 0x7f1d0c1261d0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c067350 tx=0x7f1cfc001d30 comp rx=0 tx=0).stop 2023-03-03T07:47:25.923 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.877+0000 7f1d11709700 1 -- 172.21.15.57:0/2004079253 shutdown_connections 2023-03-03T07:47:25.923 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.877+0000 7f1d11709700 1 --2- 172.21.15.57:0/2004079253 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f1cec034960 0x7f1cec036e10 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:25.923 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.877+0000 7f1d11709700 1 --2- 172.21.15.57:0/2004079253 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cf8003a20 0x7f1d0c1261d0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:25.923 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.877+0000 7f1d11709700 1 -- 172.21.15.57:0/2004079253 >> 172.21.15.57:0/2004079253 conn(0x7f1d0c06f810 msgr2=0x7f1d0c08aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:47:25.923 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.877+0000 7f1d11709700 1 -- 172.21.15.57:0/2004079253 shutdown_connections 2023-03-03T07:47:25.923 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:25.877+0000 7f1d11709700 1 -- 172.21.15.57:0/2004079253 wait complete. 2023-03-03T07:47:25.924 INFO:tasks.workunit.client.0.smithi057.stdout:+ return 0 2023-03-03T07:47:25.924 INFO:tasks.workunit.client.0.smithi057.stderr:+ grep complete /tmp/out__file 2023-03-03T07:47:25.924 INFO:tasks.workunit.client.0.smithi057.stdout: "state": "complete" 2023-03-03T07:47:25.925 INFO:tasks.workunit.client.0.smithi057.stdout:The clone_2 is completed 2023-03-03T07:47:25.925 INFO:tasks.workunit.client.0.smithi057.stderr:+ echo 'The clone_2 is completed' 2023-03-03T07:47:25.925 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in $(eval echo {1..$NUM_CLONES}) 2023-03-03T07:47:25.925 INFO:tasks.workunit.client.0.smithi057.stderr:+ ignore_failure ceph fs clone status cephfs clone_3 2023-03-03T07:47:30.212 INFO:tasks.workunit.client.0.smithi057.stderr:+ cat /tmp/error__file 2023-03-03T07:47:30.217 INFO:tasks.workunit.client.0.smithi057.stdout:+ ceph fs clone status cephfs clone_3 2023-03-03T07:47:30.217 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:26.085+0000 7f4b61945700 1 Processor -- start 2023-03-03T07:47:30.217 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:26.085+0000 7f4b61945700 1 -- start start 2023-03-03T07:47:30.217 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:26.085+0000 7f4b61945700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4b5c12ab20 0x7f4b5c12cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:30.217 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:26.085+0000 7f4b61945700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b5c08f8e0 con 0x7f4b5c08e4c0 2023-03-03T07:47:30.218 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:26.085+0000 7f4b61945700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b5c08f760 con 0x7f4b5c12ab20 2023-03-03T07:47:30.218 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:26.085+0000 7f4b5bfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4b5c12ab20 0x7f4b5c12cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:30.218 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:26.085+0000 7f4b60943700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f4b5c08e4c0 0x7f4b5c08e890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37634/0 (socket says 172.21.15.57:37634) 2023-03-03T07:47:30.218 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:26.085+0000 7f4b60943700 1 -- 172.21.15.57:0/2715723182 learned_addr learned my addr 172.21.15.57:0/2715723182 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:47:30.218 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:26.085+0000 7f4b5bfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4b5c12ab20 0x7f4b5c12cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48240/0 (socket says 172.21.15.57:48240) 2023-03-03T07:47:30.218 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:26.085+0000 7f4b5bfff700 1 -- 172.21.15.57:0/2715723182 >> v1:172.21.15.57:6789/0 conn(0x7f4b5c08e4c0 legacy=0x7f4b5c08e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:30.218 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:26.085+0000 7f4b5bfff700 1 -- 172.21.15.57:0/2715723182 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b5c090650 con 0x7f4b5c12ab20 2023-03-03T07:47:30.219 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:26.089+0000 7f4b5bfff700 1 --2- 172.21.15.57:0/2715723182 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b5c12ab20 0x7f4b5c12cf00 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f4b480097d0 tx=0x7f4b48009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bf37fa2aeb5b9a1 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:30.219 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:26.089+0000 7f4b5b7fe700 1 -- 172.21.15.57:0/2715723182 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b480041c0 con 0x7f4b5c12ab20 2023-03-03T07:47:30.219 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:26.089+0000 7f4b5b7fe700 1 -- 172.21.15.57:0/2715723182 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b48004320 con 0x7f4b5c12ab20 2023-03-03T07:47:30.219 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:26.089+0000 7f4b5b7fe700 1 -- 172.21.15.57:0/2715723182 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b480036c0 con 0x7f4b5c12ab20 2023-03-03T07:47:30.219 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:26.089+0000 7f4b61945700 1 -- 172.21.15.57:0/2715723182 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b5c12ab20 msgr2=0x7f4b5c12cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:30.219 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:26.089+0000 7f4b61945700 1 --2- 172.21.15.57:0/2715723182 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b5c12ab20 0x7f4b5c12cf00 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f4b480097d0 tx=0x7f4b48009ae0 comp rx=0 tx=0).stop 2023-03-03T07:47:30.219 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:26.089+0000 7f4b61945700 1 -- 172.21.15.57:0/2715723182 shutdown_connections 2023-03-03T07:47:30.220 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:26.089+0000 7f4b61945700 1 --2- 172.21.15.57:0/2715723182 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b5c12ab20 0x7f4b5c12cf00 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:30.220 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:26.089+0000 7f4b61945700 1 -- 172.21.15.57:0/2715723182 >> 172.21.15.57:0/2715723182 conn(0x7f4b5c089fa0 msgr2=0x7f4b5c08c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:47:30.220 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:26.089+0000 7f4b61945700 1 -- 172.21.15.57:0/2715723182 shutdown_connections 2023-03-03T07:47:30.220 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:26.089+0000 7f4b61945700 1 -- 172.21.15.57:0/2715723182 wait complete. 2023-03-03T07:47:30.220 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:26.093+0000 7f4b61945700 1 Processor -- start 2023-03-03T07:47:30.220 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:26.093+0000 7f4b61945700 1 -- start start 2023-03-03T07:47:30.220 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:26.093+0000 7f4b61945700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b5c08e4c0 0x7f4b5c1176f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:30.221 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:26.093+0000 7f4b61945700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c11a2d0 con 0x7f4b5c08e4c0 2023-03-03T07:47:30.221 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:26.097+0000 7f4b60943700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b5c08e4c0 0x7f4b5c1176f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:30.221 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:26.097+0000 7f4b60943700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b5c08e4c0 0x7f4b5c1176f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48254/0 (socket says 172.21.15.57:48254) 2023-03-03T07:47:30.221 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:26.097+0000 7f4b60943700 1 -- 172.21.15.57:0/1322790485 learned_addr learned my addr 172.21.15.57:0/1322790485 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:47:30.221 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:26.097+0000 7f4b60943700 1 -- 172.21.15.57:0/1322790485 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b480094b0 con 0x7f4b5c08e4c0 2023-03-03T07:47:30.221 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:26.097+0000 7f4b60943700 1 --2- 172.21.15.57:0/1322790485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b5c08e4c0 0x7f4b5c1176f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f4b5000c680 tx=0x7f4b5000ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:30.221 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:26.097+0000 7f4b597fa700 1 -- 172.21.15.57:0/1322790485 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b50005cc0 con 0x7f4b5c08e4c0 2023-03-03T07:47:30.222 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:26.097+0000 7f4b597fa700 1 -- 172.21.15.57:0/1322790485 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b50005e20 con 0x7f4b5c08e4c0 2023-03-03T07:47:30.222 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:26.097+0000 7f4b61945700 1 -- 172.21.15.57:0/1322790485 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b5c12d5d0 con 0x7f4b5c08e4c0 2023-03-03T07:47:30.222 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:26.097+0000 7f4b597fa700 1 -- 172.21.15.57:0/1322790485 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b50007200 con 0x7f4b5c08e4c0 2023-03-03T07:47:30.222 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:26.097+0000 7f4b61945700 1 -- 172.21.15.57:0/1322790485 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b5c12d440 con 0x7f4b5c08e4c0 2023-03-03T07:47:30.222 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:26.101+0000 7f4b61945700 1 -- 172.21.15.57:0/1322790485 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b5c12d760 con 0x7f4b5c08e4c0 2023-03-03T07:47:30.222 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:26.101+0000 7f4b597fa700 1 -- 172.21.15.57:0/1322790485 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 10) v1 ==== 42365+0+0 (secure 0 0 0) 0x7f4b50019030 con 0x7f4b5c08e4c0 2023-03-03T07:47:30.223 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:26.101+0000 7f4b597fa700 1 --2- 172.21.15.57:0/1322790485 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f4b44034960 0x7f4b44036e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:30.223 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:26.101+0000 7f4b597fa700 1 -- 172.21.15.57:0/1322790485 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 2928+0+0 (secure 0 0 0) 0x7f4b50045620 con 0x7f4b5c08e4c0 2023-03-03T07:47:30.223 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:26.101+0000 7f4b597fa700 1 -- 172.21.15.57:0/1322790485 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=38}) v3 -- 0x7f4b4403b200 con 0x7f4b5c08e4c0 2023-03-03T07:47:30.224 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:26.101+0000 7f4b5bfff700 1 --2- 172.21.15.57:0/1322790485 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f4b44034960 0x7f4b44036e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:30.224 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:26.105+0000 7f4b5bfff700 1 --2- 172.21.15.57:0/1322790485 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f4b44034960 0x7f4b44036e10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c092370 tx=0x7f4b48010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:30.224 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:26.109+0000 7f4b597fa700 1 -- 172.21.15.57:0/1322790485 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4b50017030 con 0x7f4b5c08e4c0 2023-03-03T07:47:30.224 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:26.317+0000 7f4b61945700 1 -- 172.21.15.57:0/1322790485 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f4b5c11a070 con 0x7f4b44034960 2023-03-03T07:47:30.224 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:30.033+0000 7f4b597fa700 1 -- 172.21.15.57:0/1322790485 <== mgr.4099 v2:172.21.15.57:6808/28565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+46 (secure 0 0 0) 0x7f4b5c11a070 con 0x7f4b44034960 2023-03-03T07:47:30.225 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:30.165+0000 7f4b61945700 1 -- 172.21.15.57:0/1322790485 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 1: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f4b5c0619b0 con 0x7f4b44034960 2023-03-03T07:47:30.225 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:30.177+0000 7f4b597fa700 1 -- 172.21.15.57:0/1322790485 <== mgr.4099 v2:172.21.15.57:6808/28565 2 ==== mgr_command_reply(tid 1: 0 ) v1 ==== 8+0+46 (secure 0 0 0) 0x7f4b5c0619b0 con 0x7f4b44034960 2023-03-03T07:47:30.225 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:30.177+0000 7f4b61945700 1 -- 172.21.15.57:0/1322790485 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f4b44034960 msgr2=0x7f4b44036e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:30.225 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:30.177+0000 7f4b61945700 1 --2- 172.21.15.57:0/1322790485 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f4b44034960 0x7f4b44036e10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c092370 tx=0x7f4b48010000 comp rx=0 tx=0).stop 2023-03-03T07:47:30.225 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:30.181+0000 7f4b61945700 1 -- 172.21.15.57:0/1322790485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b5c08e4c0 msgr2=0x7f4b5c1176f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:30.225 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:30.181+0000 7f4b61945700 1 --2- 172.21.15.57:0/1322790485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b5c08e4c0 0x7f4b5c1176f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f4b5000c680 tx=0x7f4b5000ca40 comp rx=0 tx=0).stop 2023-03-03T07:47:30.225 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:30.181+0000 7f4b61945700 1 -- 172.21.15.57:0/1322790485 shutdown_connections 2023-03-03T07:47:30.226 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:30.181+0000 7f4b61945700 1 --2- 172.21.15.57:0/1322790485 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f4b44034960 0x7f4b44036e10 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:30.226 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:30.181+0000 7f4b61945700 1 --2- 172.21.15.57:0/1322790485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b5c08e4c0 0x7f4b5c1176f0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:30.226 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:30.181+0000 7f4b61945700 1 -- 172.21.15.57:0/1322790485 >> 172.21.15.57:0/1322790485 conn(0x7f4b5c089fa0 msgr2=0x7f4b5c08bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:47:30.226 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:30.181+0000 7f4b61945700 1 -- 172.21.15.57:0/1322790485 shutdown_connections 2023-03-03T07:47:30.226 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:30.181+0000 7f4b61945700 1 -- 172.21.15.57:0/1322790485 wait complete. 2023-03-03T07:47:30.226 INFO:tasks.workunit.client.0.smithi057.stdout:+ return 0 2023-03-03T07:47:30.227 INFO:tasks.workunit.client.0.smithi057.stderr:+ grep complete /tmp/out__file 2023-03-03T07:47:30.227 INFO:tasks.workunit.client.0.smithi057.stdout: "state": "complete" 2023-03-03T07:47:30.227 INFO:tasks.workunit.client.0.smithi057.stdout:The clone_3 is completed 2023-03-03T07:47:30.228 INFO:tasks.workunit.client.0.smithi057.stderr:+ echo 'The clone_3 is completed' 2023-03-03T07:47:30.228 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in $(eval echo {1..$NUM_CLONES}) 2023-03-03T07:47:30.228 INFO:tasks.workunit.client.0.smithi057.stderr:+ ignore_failure ceph fs clone status cephfs clone_4 2023-03-03T07:47:34.568 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:47:35.221 INFO:tasks.workunit.client.0.smithi057.stderr:+ cat /tmp/error__file 2023-03-03T07:47:35.227 INFO:tasks.workunit.client.0.smithi057.stdout:+ ceph fs clone status cephfs clone_4 2023-03-03T07:47:35.227 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:30.393+0000 7faf17370700 1 Processor -- start 2023-03-03T07:47:35.228 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:30.393+0000 7faf17370700 1 -- start start 2023-03-03T07:47:35.228 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:30.393+0000 7faf17370700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7faf10123a60 0x7faf10123480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:35.228 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:30.393+0000 7faf17370700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf1008d930 con 0x7faf10095eb0 2023-03-03T07:47:35.228 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:30.393+0000 7faf17370700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf1012a920 con 0x7faf10123a60 2023-03-03T07:47:35.228 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:30.393+0000 7faf1636e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7faf10123a60 0x7faf10123480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:35.228 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:30.393+0000 7faf15b6d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7faf10095eb0 0x7faf10123e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:50106/0 (socket says 172.21.15.57:50106) 2023-03-03T07:47:35.228 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:30.393+0000 7faf15b6d700 1 -- 172.21.15.57:0/83309497 learned_addr learned my addr 172.21.15.57:0/83309497 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:47:35.228 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:30.397+0000 7faf1636e700 1 -- 172.21.15.57:0/83309497 >> v1:172.21.15.57:6789/0 conn(0x7faf10095eb0 legacy=0x7faf10123e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:35.229 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:30.397+0000 7faf1636e700 1 -- 172.21.15.57:0/83309497 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf1012aa60 con 0x7faf10123a60 2023-03-03T07:47:35.229 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:30.397+0000 7faf1636e700 1 --2- 172.21.15.57:0/83309497 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf10123a60 0x7faf10123480 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7faf0c0097d0 tx=0x7faf0c009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddb21ec23b3ddf9e server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:35.229 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:30.397+0000 7faf1536c700 1 -- 172.21.15.57:0/83309497 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faf0c0041c0 con 0x7faf10123a60 2023-03-03T07:47:35.229 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:30.397+0000 7faf1536c700 1 -- 172.21.15.57:0/83309497 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf0c004320 con 0x7faf10123a60 2023-03-03T07:47:35.230 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:30.397+0000 7faf1536c700 1 -- 172.21.15.57:0/83309497 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faf0c0036c0 con 0x7faf10123a60 2023-03-03T07:47:35.230 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:30.397+0000 7faf17370700 1 -- 172.21.15.57:0/83309497 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf10123a60 msgr2=0x7faf10123480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:35.230 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:30.397+0000 7faf17370700 1 --2- 172.21.15.57:0/83309497 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf10123a60 0x7faf10123480 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7faf0c0097d0 tx=0x7faf0c009ae0 comp rx=0 tx=0).stop 2023-03-03T07:47:35.230 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:30.397+0000 7faf17370700 1 -- 172.21.15.57:0/83309497 shutdown_connections 2023-03-03T07:47:35.230 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:30.397+0000 7faf17370700 1 --2- 172.21.15.57:0/83309497 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf10123a60 0x7faf10123480 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:35.230 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:30.397+0000 7faf17370700 1 -- 172.21.15.57:0/83309497 >> 172.21.15.57:0/83309497 conn(0x7faf10094b00 msgr2=0x7faf10094ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:47:35.230 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:30.401+0000 7faf17370700 1 -- 172.21.15.57:0/83309497 shutdown_connections 2023-03-03T07:47:35.230 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:30.401+0000 7faf17370700 1 -- 172.21.15.57:0/83309497 wait complete. 2023-03-03T07:47:35.231 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:30.401+0000 7faf17370700 1 Processor -- start 2023-03-03T07:47:35.231 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:30.401+0000 7faf17370700 1 -- start start 2023-03-03T07:47:35.231 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:30.401+0000 7faf17370700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf10095eb0 0x7faf1011fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:35.231 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:30.401+0000 7faf17370700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf1006b660 con 0x7faf10095eb0 2023-03-03T07:47:35.231 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:30.401+0000 7faf1636e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf10095eb0 0x7faf1011fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:35.231 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:30.401+0000 7faf1636e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf10095eb0 0x7faf1011fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52064/0 (socket says 172.21.15.57:52064) 2023-03-03T07:47:35.231 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:30.401+0000 7faf1636e700 1 -- 172.21.15.57:0/3220628403 learned_addr learned my addr 172.21.15.57:0/3220628403 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:47:35.232 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:30.405+0000 7faf1636e700 1 -- 172.21.15.57:0/3220628403 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf0c0094b0 con 0x7faf10095eb0 2023-03-03T07:47:35.232 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:30.405+0000 7faf1636e700 1 --2- 172.21.15.57:0/3220628403 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf10095eb0 0x7faf1011fda0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7faf0c009b20 tx=0x7faf0c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:35.232 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:30.405+0000 7faefeffd700 1 -- 172.21.15.57:0/3220628403 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faf0c006ea0 con 0x7faf10095eb0 2023-03-03T07:47:35.232 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:30.405+0000 7faefeffd700 1 -- 172.21.15.57:0/3220628403 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf0c011630 con 0x7faf10095eb0 2023-03-03T07:47:35.232 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:30.405+0000 7faefeffd700 1 -- 172.21.15.57:0/3220628403 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faf0c0118d0 con 0x7faf10095eb0 2023-03-03T07:47:35.232 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:30.405+0000 7faf17370700 1 -- 172.21.15.57:0/3220628403 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf10129cf0 con 0x7faf10095eb0 2023-03-03T07:47:35.232 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:30.405+0000 7faf17370700 1 -- 172.21.15.57:0/3220628403 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf10129b60 con 0x7faf10095eb0 2023-03-03T07:47:35.232 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:30.405+0000 7faefeffd700 1 -- 172.21.15.57:0/3220628403 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 10) v1 ==== 42365+0+0 (secure 0 0 0) 0x7faf0c00f050 con 0x7faf10095eb0 2023-03-03T07:47:35.233 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:30.405+0000 7faf17370700 1 -- 172.21.15.57:0/3220628403 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf10129e80 con 0x7faf10095eb0 2023-03-03T07:47:35.233 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:30.409+0000 7faefeffd700 1 --2- 172.21.15.57:0/3220628403 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7faef0034960 0x7faef0036e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:35.233 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:30.409+0000 7faefeffd700 1 -- 172.21.15.57:0/3220628403 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 2928+0+0 (secure 0 0 0) 0x7faf0c047520 con 0x7faf10095eb0 2023-03-03T07:47:35.233 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:30.409+0000 7faefeffd700 1 -- 172.21.15.57:0/3220628403 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=38}) v3 -- 0x7faef003b200 con 0x7faf10095eb0 2023-03-03T07:47:35.233 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:30.409+0000 7faf15b6d700 1 --2- 172.21.15.57:0/3220628403 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7faef0034960 0x7faef0036e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:35.233 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:30.409+0000 7faf15b6d700 1 --2- 172.21.15.57:0/3220628403 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7faef0034960 0x7faef0036e10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7faf000016a0 tx=0x7faf00007b70 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:35.233 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:30.413+0000 7faefeffd700 1 -- 172.21.15.57:0/3220628403 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7faf0c016070 con 0x7faf10095eb0 2023-03-03T07:47:35.234 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:30.625+0000 7faf17370700 1 -- 172.21.15.57:0/3220628403 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_4", "target": ["mon-mgr", ""]}) v1 -- 0x7faf100619b0 con 0x7faef0034960 2023-03-03T07:47:35.234 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.033+0000 7faefeffd700 1 -- 172.21.15.57:0/3220628403 <== mgr.4099 v2:172.21.15.57:6808/28565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+46 (secure 0 0 0) 0x7faf100619b0 con 0x7faef0034960 2023-03-03T07:47:35.234 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.177+0000 7faf17370700 1 -- 172.21.15.57:0/3220628403 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 1: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_4", "target": ["mon-mgr", ""]}) v1 -- 0x7faf100008d0 con 0x7faef0034960 2023-03-03T07:47:35.234 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.189+0000 7faefeffd700 1 -- 172.21.15.57:0/3220628403 <== mgr.4099 v2:172.21.15.57:6808/28565 2 ==== mgr_command_reply(tid 1: 0 ) v1 ==== 8+0+46 (secure 0 0 0) 0x7faf100008d0 con 0x7faef0034960 2023-03-03T07:47:35.234 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.193+0000 7faf17370700 1 -- 172.21.15.57:0/3220628403 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7faef0034960 msgr2=0x7faef0036e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:35.234 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.193+0000 7faf17370700 1 --2- 172.21.15.57:0/3220628403 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7faef0034960 0x7faef0036e10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7faf000016a0 tx=0x7faf00007b70 comp rx=0 tx=0).stop 2023-03-03T07:47:35.234 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.193+0000 7faf17370700 1 -- 172.21.15.57:0/3220628403 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf10095eb0 msgr2=0x7faf1011fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:35.235 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.193+0000 7faf17370700 1 --2- 172.21.15.57:0/3220628403 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf10095eb0 0x7faf1011fda0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7faf0c009b20 tx=0x7faf0c004770 comp rx=0 tx=0).stop 2023-03-03T07:47:35.235 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.193+0000 7faf17370700 1 -- 172.21.15.57:0/3220628403 shutdown_connections 2023-03-03T07:47:35.235 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.193+0000 7faf17370700 1 --2- 172.21.15.57:0/3220628403 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7faef0034960 0x7faef0036e10 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:35.235 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.193+0000 7faf17370700 1 --2- 172.21.15.57:0/3220628403 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf10095eb0 0x7faf1011fda0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:35.235 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.193+0000 7faf17370700 1 -- 172.21.15.57:0/3220628403 >> 172.21.15.57:0/3220628403 conn(0x7faf10094b00 msgr2=0x7faf10121380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:47:35.235 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.193+0000 7faf17370700 1 -- 172.21.15.57:0/3220628403 shutdown_connections 2023-03-03T07:47:35.235 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.193+0000 7faf17370700 1 -- 172.21.15.57:0/3220628403 wait complete. 2023-03-03T07:47:35.235 INFO:tasks.workunit.client.0.smithi057.stdout:+ return 0 2023-03-03T07:47:35.236 INFO:tasks.workunit.client.0.smithi057.stderr:+ grep complete /tmp/out__file 2023-03-03T07:47:35.236 INFO:tasks.workunit.client.0.smithi057.stdout: "state": "complete" 2023-03-03T07:47:35.237 INFO:tasks.workunit.client.0.smithi057.stdout:The clone_4 is completed 2023-03-03T07:47:35.237 INFO:tasks.workunit.client.0.smithi057.stderr:+ echo 'The clone_4 is completed' 2023-03-03T07:47:35.237 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in $(eval echo {1..$NUM_CLONES}) 2023-03-03T07:47:35.237 INFO:tasks.workunit.client.0.smithi057.stderr:+ ignore_failure ceph fs clone status cephfs clone_5 2023-03-03T07:47:40.224 INFO:tasks.workunit.client.0.smithi057.stderr:+ cat /tmp/error__file 2023-03-03T07:47:40.230 INFO:tasks.workunit.client.0.smithi057.stdout:+ ceph fs clone status cephfs clone_5 2023-03-03T07:47:40.230 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.405+0000 7f816bd49700 1 Processor -- start 2023-03-03T07:47:40.231 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.409+0000 7f816bd49700 1 -- start start 2023-03-03T07:47:40.231 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.409+0000 7f816bd49700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8164128be0 0x7f816412afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:40.231 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.409+0000 7f816bd49700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f816408dd30 con 0x7f816408c850 2023-03-03T07:47:40.231 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.409+0000 7f816bd49700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8164071fc0 con 0x7f8164128be0 2023-03-03T07:47:40.231 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.409+0000 7f8169ae5700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f816408c850 0x7f816408cc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:50122/0 (socket says 172.21.15.57:50122) 2023-03-03T07:47:40.231 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.409+0000 7f8169ae5700 1 -- 172.21.15.57:0/2211963778 learned_addr learned my addr 172.21.15.57:0/2211963778 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:47:40.231 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.409+0000 7f81692e4700 1 --2- 172.21.15.57:0/2211963778 >> v2:172.21.15.57:3300/0 conn(0x7f8164128be0 0x7f816412afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:40.232 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.409+0000 7f8168ae3700 1 -- 172.21.15.57:0/2211963778 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2932462348 0 0) 0x7f816408dd30 con 0x7f816408c850 2023-03-03T07:47:40.232 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.409+0000 7f8168ae3700 1 -- 172.21.15.57:0/2211963778 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f814c0035d0 con 0x7f816408c850 2023-03-03T07:47:40.232 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.409+0000 7f8168ae3700 1 -- 172.21.15.57:0/2211963778 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2327681435 0 0) 0x7f814c0035d0 con 0x7f816408c850 2023-03-03T07:47:40.232 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.409+0000 7f8168ae3700 1 -- 172.21.15.57:0/2211963778 >> v2:172.21.15.57:3300/0 conn(0x7f8164128be0 msgr2=0x7f816412afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T07:47:40.232 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.413+0000 7f8168ae3700 1 --2- 172.21.15.57:0/2211963778 >> v2:172.21.15.57:3300/0 conn(0x7f8164128be0 0x7f816412afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:40.232 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.413+0000 7f8168ae3700 1 -- 172.21.15.57:0/2211963778 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f816408e930 con 0x7f816408c850 2023-03-03T07:47:40.232 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.413+0000 7f8168ae3700 1 -- 172.21.15.57:0/2211963778 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (unknown 2779775165 0 0) 0x7f81600015a0 con 0x7f816408c850 2023-03-03T07:47:40.233 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.413+0000 7f8168ae3700 1 -- 172.21.15.57:0/2211963778 >> v1:172.21.15.57:6789/0 conn(0x7f816408c850 legacy=0x7f816408cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:40.233 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.413+0000 7f8168ae3700 1 --2- 172.21.15.57:0/2211963778 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f814c003a70 0x7f814c003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:40.233 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.413+0000 7f8168ae3700 1 -- 172.21.15.57:0/2211963778 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8164071fc0 con 0x7f814c003a70 2023-03-03T07:47:40.233 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.413+0000 7f81692e4700 1 --2- 172.21.15.57:0/2211963778 >> v2:172.21.15.57:3300/0 conn(0x7f8164128be0 0x7f816412afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T07:47:40.233 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.413+0000 7f8169ae5700 1 --2- 172.21.15.57:0/2211963778 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f814c003a70 0x7f814c003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:40.233 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.413+0000 7f8169ae5700 1 -- 172.21.15.57:0/2211963778 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f814c0035d0 con 0x7f814c003a70 2023-03-03T07:47:40.233 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.413+0000 7f8169ae5700 1 --2- 172.21.15.57:0/2211963778 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f814c003a70 0x7f814c003e60 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8160007f90 tx=0x7f814c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b47779fb4e0345b server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:40.234 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.413+0000 7f8168ae3700 1 -- 172.21.15.57:0/2211963778 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f816000cac0 con 0x7f814c003a70 2023-03-03T07:47:40.234 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.413+0000 7f8168ae3700 1 -- 172.21.15.57:0/2211963778 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f816000cc60 con 0x7f814c003a70 2023-03-03T07:47:40.234 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.413+0000 7f8168ae3700 1 -- 172.21.15.57:0/2211963778 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8160005980 con 0x7f814c003a70 2023-03-03T07:47:40.234 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.413+0000 7f816bd49700 1 -- 172.21.15.57:0/2211963778 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f814c003a70 msgr2=0x7f814c003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:40.234 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.413+0000 7f816bd49700 1 --2- 172.21.15.57:0/2211963778 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f814c003a70 0x7f814c003e60 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8160007f90 tx=0x7f814c0058a0 comp rx=0 tx=0).stop 2023-03-03T07:47:40.234 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.417+0000 7f816bd49700 1 -- 172.21.15.57:0/2211963778 shutdown_connections 2023-03-03T07:47:40.235 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.417+0000 7f816bd49700 1 --2- 172.21.15.57:0/2211963778 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f814c003a70 0x7f814c003e60 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:40.235 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.417+0000 7f816bd49700 1 --2- 172.21.15.57:0/2211963778 >> v2:172.21.15.57:3300/0 conn(0x7f8164128be0 0x7f816412afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:40.235 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.417+0000 7f816bd49700 1 -- 172.21.15.57:0/2211963778 >> 172.21.15.57:0/2211963778 conn(0x7f8164090990 msgr2=0x7f8164090d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:47:40.235 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.417+0000 7f816bd49700 1 -- 172.21.15.57:0/2211963778 shutdown_connections 2023-03-03T07:47:40.235 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.417+0000 7f816bd49700 1 -- 172.21.15.57:0/2211963778 wait complete. 2023-03-03T07:47:40.235 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.417+0000 7f816bd49700 1 Processor -- start 2023-03-03T07:47:40.235 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.417+0000 7f816bd49700 1 -- start start 2023-03-03T07:47:40.235 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.421+0000 7f816bd49700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f814c003a70 0x7f81641b9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:40.236 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.421+0000 7f816bd49700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f816411dc40 con 0x7f814c003a70 2023-03-03T07:47:40.236 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.421+0000 7f8169ae5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f814c003a70 0x7f81641b9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:40.236 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.421+0000 7f8169ae5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f814c003a70 0x7f81641b9cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52084/0 (socket says 172.21.15.57:52084) 2023-03-03T07:47:40.236 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.421+0000 7f8169ae5700 1 -- 172.21.15.57:0/1722504054 learned_addr learned my addr 172.21.15.57:0/1722504054 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:47:40.236 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.421+0000 7f8169ae5700 1 -- 172.21.15.57:0/1722504054 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81540094b0 con 0x7f814c003a70 2023-03-03T07:47:40.236 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.421+0000 7f8169ae5700 1 --2- 172.21.15.57:0/1722504054 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f814c003a70 0x7f81641b9cd0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8160011000 tx=0x7f816408e6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:40.236 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.421+0000 7f81527fc700 1 -- 172.21.15.57:0/1722504054 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f816000cac0 con 0x7f814c003a70 2023-03-03T07:47:40.237 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.421+0000 7f81527fc700 1 -- 172.21.15.57:0/1722504054 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8160004890 con 0x7f814c003a70 2023-03-03T07:47:40.237 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.421+0000 7f81527fc700 1 -- 172.21.15.57:0/1722504054 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8160004b30 con 0x7f814c003a70 2023-03-03T07:47:40.237 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.421+0000 7f816bd49700 1 -- 172.21.15.57:0/1722504054 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f816412b500 con 0x7f814c003a70 2023-03-03T07:47:40.237 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.421+0000 7f816bd49700 1 -- 172.21.15.57:0/1722504054 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f816408d330 con 0x7f814c003a70 2023-03-03T07:47:40.237 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.425+0000 7f81527fc700 1 -- 172.21.15.57:0/1722504054 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 10) v1 ==== 42365+0+0 (secure 0 0 0) 0x7f816002c070 con 0x7f814c003a70 2023-03-03T07:47:40.237 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.425+0000 7f816bd49700 1 -- 172.21.15.57:0/1722504054 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f816412b690 con 0x7f814c003a70 2023-03-03T07:47:40.237 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.425+0000 7f81527fc700 1 --2- 172.21.15.57:0/1722504054 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f8144034960 0x7f8144036e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:40.238 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.425+0000 7f81527fc700 1 -- 172.21.15.57:0/1722504054 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 2928+0+0 (secure 0 0 0) 0x7f81600472d0 con 0x7f814c003a70 2023-03-03T07:47:40.238 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.425+0000 7f81527fc700 1 -- 172.21.15.57:0/1722504054 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=38}) v3 -- 0x7f814403b200 con 0x7f814c003a70 2023-03-03T07:47:40.238 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.425+0000 7f81692e4700 1 --2- 172.21.15.57:0/1722504054 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f8144034960 0x7f8144036e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:40.238 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.429+0000 7f81692e4700 1 --2- 172.21.15.57:0/1722504054 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f8144034960 0x7f8144036e10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8164071b00 tx=0x7f8154009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:40.238 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.433+0000 7f81527fc700 1 -- 172.21.15.57:0/1722504054 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8160017020 con 0x7f814c003a70 2023-03-03T07:47:40.238 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:35.645+0000 7f816bd49700 1 -- 172.21.15.57:0/1722504054 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_5", "target": ["mon-mgr", ""]}) v1 -- 0x7f81640619b0 con 0x7f8144034960 2023-03-03T07:47:40.238 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:40.033+0000 7f81527fc700 1 -- 172.21.15.57:0/1722504054 <== mgr.4099 v2:172.21.15.57:6808/28565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+46 (secure 0 0 0) 0x7f81640619b0 con 0x7f8144034960 2023-03-03T07:47:40.238 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:40.177+0000 7f816bd49700 1 -- 172.21.15.57:0/1722504054 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 1: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_5", "target": ["mon-mgr", ""]}) v1 -- 0x7f816411efd0 con 0x7f8144034960 2023-03-03T07:47:40.239 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:40.189+0000 7f81527fc700 1 -- 172.21.15.57:0/1722504054 <== mgr.4099 v2:172.21.15.57:6808/28565 2 ==== mgr_command_reply(tid 1: 0 ) v1 ==== 8+0+46 (secure 0 0 0) 0x7f816411efd0 con 0x7f8144034960 2023-03-03T07:47:40.239 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:40.193+0000 7f816bd49700 1 -- 172.21.15.57:0/1722504054 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f8144034960 msgr2=0x7f8144036e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:40.239 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:40.193+0000 7f816bd49700 1 --2- 172.21.15.57:0/1722504054 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f8144034960 0x7f8144036e10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8164071b00 tx=0x7f8154009240 comp rx=0 tx=0).stop 2023-03-03T07:47:40.239 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:40.193+0000 7f816bd49700 1 -- 172.21.15.57:0/1722504054 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f814c003a70 msgr2=0x7f81641b9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:40.239 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:40.193+0000 7f816bd49700 1 --2- 172.21.15.57:0/1722504054 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f814c003a70 0x7f81641b9cd0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8160011000 tx=0x7f816408e6e0 comp rx=0 tx=0).stop 2023-03-03T07:47:40.239 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:40.193+0000 7f816bd49700 1 -- 172.21.15.57:0/1722504054 shutdown_connections 2023-03-03T07:47:40.239 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:40.193+0000 7f816bd49700 1 --2- 172.21.15.57:0/1722504054 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f8144034960 0x7f8144036e10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:40.239 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:40.193+0000 7f816bd49700 1 --2- 172.21.15.57:0/1722504054 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f814c003a70 0x7f81641b9cd0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:40.240 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:40.193+0000 7f816bd49700 1 -- 172.21.15.57:0/1722504054 >> 172.21.15.57:0/1722504054 conn(0x7f8164090990 msgr2=0x7f816412a090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:47:40.240 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:40.193+0000 7f816bd49700 1 -- 172.21.15.57:0/1722504054 shutdown_connections 2023-03-03T07:47:40.240 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:40.193+0000 7f816bd49700 1 -- 172.21.15.57:0/1722504054 wait complete. 2023-03-03T07:47:40.240 INFO:tasks.workunit.client.0.smithi057.stdout:+ return 0 2023-03-03T07:47:40.240 INFO:tasks.workunit.client.0.smithi057.stderr:+ grep complete /tmp/out__file 2023-03-03T07:47:40.241 INFO:tasks.workunit.client.0.smithi057.stdout: "state": "complete" 2023-03-03T07:47:40.241 INFO:tasks.workunit.client.0.smithi057.stdout:The clone_5 is completed 2023-03-03T07:47:40.241 INFO:tasks.workunit.client.0.smithi057.stderr:+ echo 'The clone_5 is completed' 2023-03-03T07:47:40.241 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in $(eval echo {1..$NUM_CLONES}) 2023-03-03T07:47:40.242 INFO:tasks.workunit.client.0.smithi057.stderr:+ ignore_failure ceph fs clone status cephfs clone_6 2023-03-03T07:47:45.220 INFO:tasks.workunit.client.0.smithi057.stderr:+ cat /tmp/error__file 2023-03-03T07:47:45.226 INFO:tasks.workunit.client.0.smithi057.stdout:+ ceph fs clone status cephfs clone_6 2023-03-03T07:47:45.226 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:40.405+0000 7fa03b59e700 1 Processor -- start 2023-03-03T07:47:45.226 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:40.405+0000 7fa03b59e700 1 -- start start 2023-03-03T07:47:45.226 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:40.405+0000 7fa03b59e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa03c123a60 0x7fa03c123480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:45.227 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:40.405+0000 7fa03b59e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa03c08d930 con 0x7fa03c095eb0 2023-03-03T07:47:45.227 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:40.405+0000 7fa03b59e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa03c12a920 con 0x7fa03c123a60 2023-03-03T07:47:45.227 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:40.409+0000 7fa039d9b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa03c095eb0 0x7fa03c123e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52334/0 (socket says 172.21.15.57:52334) 2023-03-03T07:47:45.227 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:40.409+0000 7fa039d9b700 1 -- 172.21.15.57:0/749204667 learned_addr learned my addr 172.21.15.57:0/749204667 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:47:45.227 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:40.409+0000 7fa03a59c700 1 --2- 172.21.15.57:0/749204667 >> v2:172.21.15.57:3300/0 conn(0x7fa03c123a60 0x7fa03c123480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:45.227 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:40.409+0000 7fa03959a700 1 -- 172.21.15.57:0/749204667 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3054274748 0 0) 0x7fa03c08d930 con 0x7fa03c095eb0 2023-03-03T07:47:45.227 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:40.409+0000 7fa03a59c700 1 -- 172.21.15.57:0/749204667 >> v1:172.21.15.57:6789/0 conn(0x7fa03c095eb0 legacy=0x7fa03c123e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:45.228 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:40.409+0000 7fa03a59c700 1 -- 172.21.15.57:0/749204667 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa03c12aa60 con 0x7fa03c123a60 2023-03-03T07:47:45.228 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:40.409+0000 7fa03a59c700 1 --2- 172.21.15.57:0/749204667 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa03c123a60 0x7fa03c123480 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa02c0097d0 tx=0x7fa02c009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1f6fd3794fc0067 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:45.228 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:40.409+0000 7fa03959a700 1 -- 172.21.15.57:0/749204667 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa02c0041c0 con 0x7fa03c123a60 2023-03-03T07:47:45.228 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:40.409+0000 7fa03959a700 1 -- 172.21.15.57:0/749204667 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa02c004320 con 0x7fa03c123a60 2023-03-03T07:47:45.228 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:40.409+0000 7fa03959a700 1 -- 172.21.15.57:0/749204667 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa02c0036c0 con 0x7fa03c123a60 2023-03-03T07:47:45.228 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:40.409+0000 7fa03b59e700 1 -- 172.21.15.57:0/749204667 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa03c123a60 msgr2=0x7fa03c123480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:45.228 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:40.409+0000 7fa03b59e700 1 --2- 172.21.15.57:0/749204667 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa03c123a60 0x7fa03c123480 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa02c0097d0 tx=0x7fa02c009ae0 comp rx=0 tx=0).stop 2023-03-03T07:47:45.228 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:40.413+0000 7fa03b59e700 1 -- 172.21.15.57:0/749204667 shutdown_connections 2023-03-03T07:47:45.229 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:40.413+0000 7fa03b59e700 1 --2- 172.21.15.57:0/749204667 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa03c123a60 0x7fa03c123480 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:45.229 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:40.413+0000 7fa03b59e700 1 -- 172.21.15.57:0/749204667 >> 172.21.15.57:0/749204667 conn(0x7fa03c094b00 msgr2=0x7fa03c094ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:47:45.229 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:40.413+0000 7fa03b59e700 1 -- 172.21.15.57:0/749204667 shutdown_connections 2023-03-03T07:47:45.229 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:40.413+0000 7fa03b59e700 1 -- 172.21.15.57:0/749204667 wait complete. 2023-03-03T07:47:45.229 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:40.413+0000 7fa03b59e700 1 Processor -- start 2023-03-03T07:47:45.229 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:40.417+0000 7fa03b59e700 1 -- start start 2023-03-03T07:47:45.229 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:40.417+0000 7fa03b59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa03c095eb0 0x7fa03c11fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:45.230 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:40.417+0000 7fa03b59e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03c06b140 con 0x7fa03c095eb0 2023-03-03T07:47:45.230 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:40.417+0000 7fa03a59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa03c095eb0 0x7fa03c11fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:45.230 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:40.417+0000 7fa03a59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa03c095eb0 0x7fa03c11fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46364/0 (socket says 172.21.15.57:46364) 2023-03-03T07:47:45.230 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:40.417+0000 7fa03a59c700 1 -- 172.21.15.57:0/617072851 learned_addr learned my addr 172.21.15.57:0/617072851 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:47:45.230 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:40.417+0000 7fa03a59c700 1 -- 172.21.15.57:0/617072851 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa02c0094b0 con 0x7fa03c095eb0 2023-03-03T07:47:45.230 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:40.417+0000 7fa03a59c700 1 --2- 172.21.15.57:0/617072851 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa03c095eb0 0x7fa03c11fb80 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa02c0090b0 tx=0x7fa02c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:45.230 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:40.417+0000 7fa02affd700 1 -- 172.21.15.57:0/617072851 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa02c006ea0 con 0x7fa03c095eb0 2023-03-03T07:47:45.230 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:40.417+0000 7fa02affd700 1 -- 172.21.15.57:0/617072851 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa02c011760 con 0x7fa03c095eb0 2023-03-03T07:47:45.231 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:40.417+0000 7fa02affd700 1 -- 172.21.15.57:0/617072851 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa02c011a20 con 0x7fa03c095eb0 2023-03-03T07:47:45.231 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:40.417+0000 7fa03b59e700 1 -- 172.21.15.57:0/617072851 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa03c129cf0 con 0x7fa03c095eb0 2023-03-03T07:47:45.231 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:40.421+0000 7fa03b59e700 1 -- 172.21.15.57:0/617072851 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa03c129b60 con 0x7fa03c095eb0 2023-03-03T07:47:45.231 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:40.421+0000 7fa03b59e700 1 -- 172.21.15.57:0/617072851 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa03c129e80 con 0x7fa03c095eb0 2023-03-03T07:47:45.231 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:40.421+0000 7fa02affd700 1 -- 172.21.15.57:0/617072851 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 10) v1 ==== 42365+0+0 (secure 0 0 0) 0x7fa02c02d070 con 0x7fa03c095eb0 2023-03-03T07:47:45.231 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:40.421+0000 7fa02affd700 1 --2- 172.21.15.57:0/617072851 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fa018034960 0x7fa018036e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:45.231 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:40.421+0000 7fa02affd700 1 -- 172.21.15.57:0/617072851 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 2928+0+0 (secure 0 0 0) 0x7fa02c047350 con 0x7fa03c095eb0 2023-03-03T07:47:45.231 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:40.425+0000 7fa039d9b700 1 --2- 172.21.15.57:0/617072851 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fa018034960 0x7fa018036e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:45.232 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:40.425+0000 7fa02affd700 1 -- 172.21.15.57:0/617072851 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=38}) v3 -- 0x7fa01803b200 con 0x7fa03c095eb0 2023-03-03T07:47:45.232 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:40.425+0000 7fa039d9b700 1 --2- 172.21.15.57:0/617072851 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fa018034960 0x7fa018036e10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa030000c00 tx=0x7fa0300079c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:45.232 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:40.429+0000 7fa02affd700 1 -- 172.21.15.57:0/617072851 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa02c016020 con 0x7fa03c095eb0 2023-03-03T07:47:45.232 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:40.637+0000 7fa03b59e700 1 -- 172.21.15.57:0/617072851 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_6", "target": ["mon-mgr", ""]}) v1 -- 0x7fa03c06a080 con 0x7fa018034960 2023-03-03T07:47:45.232 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:45.033+0000 7fa02affd700 1 -- 172.21.15.57:0/617072851 <== mgr.4099 v2:172.21.15.57:6808/28565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+46 (secure 0 0 0) 0x7fa03c06a080 con 0x7fa018034960 2023-03-03T07:47:45.232 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:45.173+0000 7fa03b59e700 1 -- 172.21.15.57:0/617072851 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 1: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_6", "target": ["mon-mgr", ""]}) v1 -- 0x7fa03c06ad90 con 0x7fa018034960 2023-03-03T07:47:45.232 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:45.185+0000 7fa02affd700 1 -- 172.21.15.57:0/617072851 <== mgr.4099 v2:172.21.15.57:6808/28565 2 ==== mgr_command_reply(tid 1: 0 ) v1 ==== 8+0+46 (secure 0 0 0) 0x7fa03c06ad90 con 0x7fa018034960 2023-03-03T07:47:45.233 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:45.189+0000 7fa03b59e700 1 -- 172.21.15.57:0/617072851 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fa018034960 msgr2=0x7fa018036e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:45.233 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:45.189+0000 7fa03b59e700 1 --2- 172.21.15.57:0/617072851 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fa018034960 0x7fa018036e10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa030000c00 tx=0x7fa0300079c0 comp rx=0 tx=0).stop 2023-03-03T07:47:45.233 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:45.189+0000 7fa03b59e700 1 -- 172.21.15.57:0/617072851 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa03c095eb0 msgr2=0x7fa03c11fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:45.233 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:45.189+0000 7fa03b59e700 1 --2- 172.21.15.57:0/617072851 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa03c095eb0 0x7fa03c11fb80 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa02c0090b0 tx=0x7fa02c004770 comp rx=0 tx=0).stop 2023-03-03T07:47:45.233 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:45.189+0000 7fa03b59e700 1 -- 172.21.15.57:0/617072851 shutdown_connections 2023-03-03T07:47:45.233 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:45.189+0000 7fa03b59e700 1 --2- 172.21.15.57:0/617072851 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fa018034960 0x7fa018036e10 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:45.233 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:45.189+0000 7fa03b59e700 1 --2- 172.21.15.57:0/617072851 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa03c095eb0 0x7fa03c11fb80 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:45.234 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:45.189+0000 7fa03b59e700 1 -- 172.21.15.57:0/617072851 >> 172.21.15.57:0/617072851 conn(0x7fa03c094b00 msgr2=0x7fa03c121df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:47:45.234 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:45.189+0000 7fa03b59e700 1 -- 172.21.15.57:0/617072851 shutdown_connections 2023-03-03T07:47:45.234 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:45.189+0000 7fa03b59e700 1 -- 172.21.15.57:0/617072851 wait complete. 2023-03-03T07:47:45.234 INFO:tasks.workunit.client.0.smithi057.stdout:+ return 0 2023-03-03T07:47:45.234 INFO:tasks.workunit.client.0.smithi057.stderr:+ grep complete /tmp/out__file 2023-03-03T07:47:45.235 INFO:tasks.workunit.client.0.smithi057.stdout: "state": "complete" 2023-03-03T07:47:45.235 INFO:tasks.workunit.client.0.smithi057.stderr:+ echo 'The clone_6 is completed' 2023-03-03T07:47:45.235 INFO:tasks.workunit.client.0.smithi057.stdout:The clone_6 is completed 2023-03-03T07:47:45.236 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in $(eval echo {1..$NUM_CLONES}) 2023-03-03T07:47:45.236 INFO:tasks.workunit.client.0.smithi057.stderr:+ ignore_failure ceph fs clone status cephfs clone_7 2023-03-03T07:47:50.278 INFO:tasks.workunit.client.0.smithi057.stderr:+ cat /tmp/error__file 2023-03-03T07:47:50.285 INFO:tasks.workunit.client.0.smithi057.stdout:+ ceph fs clone status cephfs clone_7 2023-03-03T07:47:50.285 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:45.393+0000 7fdb5175d700 1 Processor -- start 2023-03-03T07:47:50.285 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:45.393+0000 7fdb5175d700 1 -- start start 2023-03-03T07:47:50.285 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:45.393+0000 7fdb5175d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdb4c12bdf0 0x7fdb4c12c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:50.285 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:45.393+0000 7fdb5175d700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb4c08d490 con 0x7fdb4c08afb0 2023-03-03T07:47:50.285 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:45.393+0000 7fdb5175d700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb4c12c700 con 0x7fdb4c12bdf0 2023-03-03T07:47:50.286 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:45.397+0000 7fdb4bfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdb4c12bdf0 0x7fdb4c12c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:50.286 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:45.397+0000 7fdb437fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fdb4c08afb0 0x7fdb4c08b410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52348/0 (socket says 172.21.15.57:52348) 2023-03-03T07:47:50.286 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:45.397+0000 7fdb437fe700 1 -- 172.21.15.57:0/2698440853 learned_addr learned my addr 172.21.15.57:0/2698440853 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:47:50.286 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:45.397+0000 7fdb4b7fe700 1 -- 172.21.15.57:0/2698440853 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 99174130 0 0) 0x7fdb4c08d490 con 0x7fdb4c08afb0 2023-03-03T07:47:50.286 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:45.397+0000 7fdb4b7fe700 1 -- 172.21.15.57:0/2698440853 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb2c0035d0 con 0x7fdb4c08afb0 2023-03-03T07:47:50.286 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:45.397+0000 7fdb4bfff700 1 -- 172.21.15.57:0/2698440853 >> v1:172.21.15.57:6789/0 conn(0x7fdb4c08afb0 legacy=0x7fdb4c08b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:50.286 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:45.397+0000 7fdb4bfff700 1 -- 172.21.15.57:0/2698440853 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb4c12b870 con 0x7fdb4c12bdf0 2023-03-03T07:47:50.287 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:45.397+0000 7fdb4bfff700 1 --2- 172.21.15.57:0/2698440853 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb4c12bdf0 0x7fdb4c12c1c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c0097d0 tx=0x7fdb3c009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11d042d138649756 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:50.287 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:45.397+0000 7fdb4b7fe700 1 -- 172.21.15.57:0/2698440853 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdb3c004160 con 0x7fdb4c12bdf0 2023-03-03T07:47:50.287 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:45.397+0000 7fdb4b7fe700 1 -- 172.21.15.57:0/2698440853 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb3c0042c0 con 0x7fdb4c12bdf0 2023-03-03T07:47:50.287 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:45.397+0000 7fdb4b7fe700 1 -- 172.21.15.57:0/2698440853 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdb3c0045a0 con 0x7fdb4c12bdf0 2023-03-03T07:47:50.287 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:45.401+0000 7fdb5175d700 1 -- 172.21.15.57:0/2698440853 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb4c12bdf0 msgr2=0x7fdb4c12c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:50.287 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:45.401+0000 7fdb5175d700 1 --2- 172.21.15.57:0/2698440853 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb4c12bdf0 0x7fdb4c12c1c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c0097d0 tx=0x7fdb3c009ae0 comp rx=0 tx=0).stop 2023-03-03T07:47:50.287 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:45.401+0000 7fdb5175d700 1 -- 172.21.15.57:0/2698440853 shutdown_connections 2023-03-03T07:47:50.287 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:45.401+0000 7fdb5175d700 1 --2- 172.21.15.57:0/2698440853 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb4c12bdf0 0x7fdb4c12c1c0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:50.288 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:45.401+0000 7fdb5175d700 1 -- 172.21.15.57:0/2698440853 >> 172.21.15.57:0/2698440853 conn(0x7fdb4c094b00 msgr2=0x7fdb4c094ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:47:50.288 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:45.401+0000 7fdb5175d700 1 -- 172.21.15.57:0/2698440853 shutdown_connections 2023-03-03T07:47:50.288 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:45.401+0000 7fdb5175d700 1 -- 172.21.15.57:0/2698440853 wait complete. 2023-03-03T07:47:50.288 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:45.401+0000 7fdb5175d700 1 Processor -- start 2023-03-03T07:47:50.288 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:45.401+0000 7fdb5175d700 1 -- start start 2023-03-03T07:47:50.288 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:45.405+0000 7fdb5175d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb4c08afb0 0x7fdb4c070da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:50.288 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:45.405+0000 7fdb5175d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4c070710 con 0x7fdb4c08afb0 2023-03-03T07:47:50.288 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:45.405+0000 7fdb4bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb4c08afb0 0x7fdb4c070da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:50.289 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:45.405+0000 7fdb4bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb4c08afb0 0x7fdb4c070da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46382/0 (socket says 172.21.15.57:46382) 2023-03-03T07:47:50.289 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:45.405+0000 7fdb4bfff700 1 -- 172.21.15.57:0/4055499958 learned_addr learned my addr 172.21.15.57:0/4055499958 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:47:50.289 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:45.405+0000 7fdb4bfff700 1 -- 172.21.15.57:0/4055499958 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb3c0094b0 con 0x7fdb4c08afb0 2023-03-03T07:47:50.289 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:45.405+0000 7fdb4bfff700 1 --2- 172.21.15.57:0/4055499958 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb4c08afb0 0x7fdb4c070da0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c0090b0 tx=0x7fdb3c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:50.289 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:45.405+0000 7fdb497fa700 1 -- 172.21.15.57:0/4055499958 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdb3c003c80 con 0x7fdb4c08afb0 2023-03-03T07:47:50.289 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:45.405+0000 7fdb5175d700 1 -- 172.21.15.57:0/4055499958 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb4c131ba0 con 0x7fdb4c08afb0 2023-03-03T07:47:50.289 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:45.405+0000 7fdb497fa700 1 -- 172.21.15.57:0/4055499958 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb3c01f070 con 0x7fdb4c08afb0 2023-03-03T07:47:50.290 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:45.405+0000 7fdb497fa700 1 -- 172.21.15.57:0/4055499958 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdb3c011630 con 0x7fdb4c08afb0 2023-03-03T07:47:50.290 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:45.409+0000 7fdb5175d700 1 -- 172.21.15.57:0/4055499958 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb4c08bd30 con 0x7fdb4c08afb0 2023-03-03T07:47:50.290 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:45.409+0000 7fdb5175d700 1 -- 172.21.15.57:0/4055499958 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb4c131d30 con 0x7fdb4c08afb0 2023-03-03T07:47:50.290 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:45.409+0000 7fdb497fa700 1 -- 172.21.15.57:0/4055499958 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 10) v1 ==== 42365+0+0 (secure 0 0 0) 0x7fdb3c02a020 con 0x7fdb4c08afb0 2023-03-03T07:47:50.290 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:45.409+0000 7fdb497fa700 1 --2- 172.21.15.57:0/4055499958 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fdb30034900 0x7fdb30036db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:50.290 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:45.409+0000 7fdb497fa700 1 -- 172.21.15.57:0/4055499958 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 2928+0+0 (secure 0 0 0) 0x7fdb3c047ae0 con 0x7fdb4c08afb0 2023-03-03T07:47:50.290 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:45.409+0000 7fdb497fa700 1 -- 172.21.15.57:0/4055499958 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=38}) v3 -- 0x7fdb3003b1a0 con 0x7fdb4c08afb0 2023-03-03T07:47:50.291 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:45.409+0000 7fdb437fe700 1 --2- 172.21.15.57:0/4055499958 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fdb30034900 0x7fdb30036db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:50.291 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:45.413+0000 7fdb437fe700 1 --2- 172.21.15.57:0/4055499958 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fdb30034900 0x7fdb30036db0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdb340016d0 tx=0x7fdb34007a20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:50.291 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:45.417+0000 7fdb497fa700 1 -- 172.21.15.57:0/4055499958 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fdb3c01a460 con 0x7fdb4c08afb0 2023-03-03T07:47:50.291 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:45.629+0000 7fdb5175d700 1 -- 172.21.15.57:0/4055499958 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_7", "target": ["mon-mgr", ""]}) v1 -- 0x7fdb4c070850 con 0x7fdb30034900 2023-03-03T07:47:50.291 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.029+0000 7fdb497fa700 1 -- 172.21.15.57:0/4055499958 <== mgr.4099 v2:172.21.15.57:6808/28565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+46 (secure 0 0 0) 0x7fdb4c070850 con 0x7fdb30034900 2023-03-03T07:47:50.291 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.229+0000 7fdb5175d700 1 -- 172.21.15.57:0/4055499958 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 1: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_7", "target": ["mon-mgr", ""]}) v1 -- 0x7fdb4c0619b0 con 0x7fdb30034900 2023-03-03T07:47:50.291 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.241+0000 7fdb497fa700 1 -- 172.21.15.57:0/4055499958 <== mgr.4099 v2:172.21.15.57:6808/28565 2 ==== mgr_command_reply(tid 1: 0 ) v1 ==== 8+0+46 (secure 0 0 0) 0x7fdb4c0619b0 con 0x7fdb30034900 2023-03-03T07:47:50.291 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.245+0000 7fdb5175d700 1 -- 172.21.15.57:0/4055499958 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fdb30034900 msgr2=0x7fdb30036db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:50.292 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.245+0000 7fdb5175d700 1 --2- 172.21.15.57:0/4055499958 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fdb30034900 0x7fdb30036db0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdb340016d0 tx=0x7fdb34007a20 comp rx=0 tx=0).stop 2023-03-03T07:47:50.292 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.245+0000 7fdb5175d700 1 -- 172.21.15.57:0/4055499958 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb4c08afb0 msgr2=0x7fdb4c070da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:50.292 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.245+0000 7fdb5175d700 1 --2- 172.21.15.57:0/4055499958 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb4c08afb0 0x7fdb4c070da0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c0090b0 tx=0x7fdb3c004770 comp rx=0 tx=0).stop 2023-03-03T07:47:50.292 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.245+0000 7fdb5175d700 1 -- 172.21.15.57:0/4055499958 shutdown_connections 2023-03-03T07:47:50.292 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.245+0000 7fdb5175d700 1 --2- 172.21.15.57:0/4055499958 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fdb30034900 0x7fdb30036db0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:50.292 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.245+0000 7fdb5175d700 1 --2- 172.21.15.57:0/4055499958 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb4c08afb0 0x7fdb4c070da0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:50.292 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.245+0000 7fdb5175d700 1 -- 172.21.15.57:0/4055499958 >> 172.21.15.57:0/4055499958 conn(0x7fdb4c094b00 msgr2=0x7fdb4c0911c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:47:50.292 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.245+0000 7fdb5175d700 1 -- 172.21.15.57:0/4055499958 shutdown_connections 2023-03-03T07:47:50.293 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.245+0000 7fdb5175d700 1 -- 172.21.15.57:0/4055499958 wait complete. 2023-03-03T07:47:50.293 INFO:tasks.workunit.client.0.smithi057.stdout:+ return 0 2023-03-03T07:47:50.293 INFO:tasks.workunit.client.0.smithi057.stderr:+ grep complete /tmp/out__file 2023-03-03T07:47:50.294 INFO:tasks.workunit.client.0.smithi057.stdout: "state": "complete" 2023-03-03T07:47:50.294 INFO:tasks.workunit.client.0.smithi057.stdout:The clone_7 is completed 2023-03-03T07:47:50.294 INFO:tasks.workunit.client.0.smithi057.stderr:+ echo 'The clone_7 is completed' 2023-03-03T07:47:50.294 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in $(eval echo {1..$NUM_CLONES}) 2023-03-03T07:47:50.294 INFO:tasks.workunit.client.0.smithi057.stderr:+ ignore_failure ceph fs clone status cephfs clone_8 2023-03-03T07:47:50.884 INFO:tasks.workunit.client.0.smithi057.stderr:+ cat /tmp/error__file 2023-03-03T07:47:50.890 INFO:tasks.workunit.client.0.smithi057.stdout:+ ceph fs clone status cephfs clone_8 2023-03-03T07:47:50.890 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.449+0000 7fe95b1df700 1 Processor -- start 2023-03-03T07:47:50.890 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.453+0000 7fe95b1df700 1 -- start start 2023-03-03T07:47:50.890 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.453+0000 7fe95b1df700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe9540711d0 0x7fe95408eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:50.890 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.453+0000 7fe95b1df700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe95408f9c0 con 0x7fe954070e00 2023-03-03T07:47:50.891 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.453+0000 7fe95b1df700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe95408fcd0 con 0x7fe9540711d0 2023-03-03T07:47:50.891 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.453+0000 7fe95a1dd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fe954070e00 0x7fe95408e3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:46590/0 (socket says 172.21.15.57:46590) 2023-03-03T07:47:50.891 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.453+0000 7fe9599dc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe9540711d0 0x7fe95408eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:50.891 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.453+0000 7fe95a1dd700 1 -- 172.21.15.57:0/1074508391 learned_addr learned my addr 172.21.15.57:0/1074508391 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:47:50.891 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.457+0000 7fe9599dc700 1 -- 172.21.15.57:0/1074508391 >> v1:172.21.15.57:6789/0 conn(0x7fe954070e00 legacy=0x7fe95408e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:50.891 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.457+0000 7fe9599dc700 1 -- 172.21.15.57:0/1074508391 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe954071600 con 0x7fe9540711d0 2023-03-03T07:47:50.891 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.457+0000 7fe9599dc700 1 --2- 172.21.15.57:0/1074508391 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9540711d0 0x7fe95408eac0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe9440097d0 tx=0x7fe944009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3645ec15f8063b54 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:50.892 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.457+0000 7fe9591db700 1 -- 172.21.15.57:0/1074508391 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe9440041c0 con 0x7fe9540711d0 2023-03-03T07:47:50.892 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.457+0000 7fe9591db700 1 -- 172.21.15.57:0/1074508391 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe944004320 con 0x7fe9540711d0 2023-03-03T07:47:50.892 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.457+0000 7fe9591db700 1 -- 172.21.15.57:0/1074508391 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe9440036c0 con 0x7fe9540711d0 2023-03-03T07:47:50.892 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.457+0000 7fe95b1df700 1 -- 172.21.15.57:0/1074508391 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9540711d0 msgr2=0x7fe95408eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:50.892 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.457+0000 7fe95b1df700 1 --2- 172.21.15.57:0/1074508391 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9540711d0 0x7fe95408eac0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe9440097d0 tx=0x7fe944009ae0 comp rx=0 tx=0).stop 2023-03-03T07:47:50.892 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.457+0000 7fe95b1df700 1 -- 172.21.15.57:0/1074508391 shutdown_connections 2023-03-03T07:47:50.892 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.457+0000 7fe95b1df700 1 --2- 172.21.15.57:0/1074508391 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9540711d0 0x7fe95408eac0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:50.893 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.457+0000 7fe95b1df700 1 -- 172.21.15.57:0/1074508391 >> 172.21.15.57:0/1074508391 conn(0x7fe9540948c0 msgr2=0x7fe954096cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:47:50.893 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.457+0000 7fe95b1df700 1 -- 172.21.15.57:0/1074508391 shutdown_connections 2023-03-03T07:47:50.893 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.457+0000 7fe95b1df700 1 -- 172.21.15.57:0/1074508391 wait complete. 2023-03-03T07:47:50.893 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.461+0000 7fe95b1df700 1 Processor -- start 2023-03-03T07:47:50.893 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.461+0000 7fe95b1df700 1 -- start start 2023-03-03T07:47:50.893 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.461+0000 7fe95b1df700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe954070e00 0x7fe95411ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:50.893 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.461+0000 7fe95b1df700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe954128680 con 0x7fe954070e00 2023-03-03T07:47:50.893 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.461+0000 7fe95a1dd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe954070e00 0x7fe95411ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:50.894 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.461+0000 7fe95a1dd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe954070e00 0x7fe95411ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56166/0 (socket says 172.21.15.57:56166) 2023-03-03T07:47:50.894 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.461+0000 7fe95a1dd700 1 -- 172.21.15.57:0/2635427198 learned_addr learned my addr 172.21.15.57:0/2635427198 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:47:50.894 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.461+0000 7fe95a1dd700 1 -- 172.21.15.57:0/2635427198 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9440094b0 con 0x7fe954070e00 2023-03-03T07:47:50.894 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.461+0000 7fe95a1dd700 1 --2- 172.21.15.57:0/2635427198 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe954070e00 0x7fe95411ced0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe95000c680 tx=0x7fe95000ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:50.894 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.461+0000 7fe942ffd700 1 -- 172.21.15.57:0/2635427198 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe950005cc0 con 0x7fe954070e00 2023-03-03T07:47:50.894 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.461+0000 7fe942ffd700 1 -- 172.21.15.57:0/2635427198 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe950005e20 con 0x7fe954070e00 2023-03-03T07:47:50.894 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.461+0000 7fe942ffd700 1 -- 172.21.15.57:0/2635427198 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe950007200 con 0x7fe954070e00 2023-03-03T07:47:50.895 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.461+0000 7fe95b1df700 1 -- 172.21.15.57:0/2635427198 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe95412db30 con 0x7fe954070e00 2023-03-03T07:47:50.895 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.465+0000 7fe95b1df700 1 -- 172.21.15.57:0/2635427198 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe95412d9a0 con 0x7fe954070e00 2023-03-03T07:47:50.895 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.465+0000 7fe95b1df700 1 -- 172.21.15.57:0/2635427198 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe95412dcc0 con 0x7fe954070e00 2023-03-03T07:47:50.895 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.465+0000 7fe942ffd700 1 -- 172.21.15.57:0/2635427198 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 10) v1 ==== 42365+0+0 (secure 0 0 0) 0x7fe950019030 con 0x7fe954070e00 2023-03-03T07:47:50.895 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.465+0000 7fe942ffd700 1 --2- 172.21.15.57:0/2635427198 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fe934034960 0x7fe934036e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:50.895 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.465+0000 7fe942ffd700 1 -- 172.21.15.57:0/2635427198 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 2928+0+0 (secure 0 0 0) 0x7fe9500456d0 con 0x7fe954070e00 2023-03-03T07:47:50.895 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.465+0000 7fe942ffd700 1 -- 172.21.15.57:0/2635427198 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=38}) v3 -- 0x7fe93403b200 con 0x7fe954070e00 2023-03-03T07:47:50.895 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.465+0000 7fe9599dc700 1 --2- 172.21.15.57:0/2635427198 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fe934034960 0x7fe934036e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:50.896 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.469+0000 7fe9599dc700 1 --2- 172.21.15.57:0/2635427198 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fe934034960 0x7fe934036e10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe944014040 tx=0x7fe944010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:50.896 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.473+0000 7fe942ffd700 1 -- 172.21.15.57:0/2635427198 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe950017030 con 0x7fe954070e00 2023-03-03T07:47:50.896 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.685+0000 7fe95b1df700 1 -- 172.21.15.57:0/2635427198 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_8", "target": ["mon-mgr", ""]}) v1 -- 0x7fe9540619b0 con 0x7fe934034960 2023-03-03T07:47:50.896 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.701+0000 7fe942ffd700 1 -- 172.21.15.57:0/2635427198 <== mgr.4099 v2:172.21.15.57:6808/28565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+149 (secure 0 0 0) 0x7fe9540619b0 con 0x7fe934034960 2023-03-03T07:47:50.896 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.837+0000 7fe95b1df700 1 -- 172.21.15.57:0/2635427198 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 1: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_8", "target": ["mon-mgr", ""]}) v1 -- 0x7fe9541287c0 con 0x7fe934034960 2023-03-03T07:47:50.896 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.849+0000 7fe942ffd700 1 -- 172.21.15.57:0/2635427198 <== mgr.4099 v2:172.21.15.57:6808/28565 2 ==== mgr_command_reply(tid 1: 0 ) v1 ==== 8+0+149 (secure 0 0 0) 0x7fe9541287c0 con 0x7fe934034960 2023-03-03T07:47:50.896 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.853+0000 7fe95b1df700 1 -- 172.21.15.57:0/2635427198 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fe934034960 msgr2=0x7fe934036e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:50.897 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.853+0000 7fe95b1df700 1 --2- 172.21.15.57:0/2635427198 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fe934034960 0x7fe934036e10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe944014040 tx=0x7fe944010000 comp rx=0 tx=0).stop 2023-03-03T07:47:50.897 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.853+0000 7fe95b1df700 1 -- 172.21.15.57:0/2635427198 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe954070e00 msgr2=0x7fe95411ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:50.897 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.853+0000 7fe95b1df700 1 --2- 172.21.15.57:0/2635427198 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe954070e00 0x7fe95411ced0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe95000c680 tx=0x7fe95000ca40 comp rx=0 tx=0).stop 2023-03-03T07:47:50.897 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.853+0000 7fe95b1df700 1 -- 172.21.15.57:0/2635427198 shutdown_connections 2023-03-03T07:47:50.897 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.853+0000 7fe95b1df700 1 --2- 172.21.15.57:0/2635427198 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fe934034960 0x7fe934036e10 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:50.897 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.853+0000 7fe95b1df700 1 --2- 172.21.15.57:0/2635427198 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe954070e00 0x7fe95411ced0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:50.897 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.853+0000 7fe95b1df700 1 -- 172.21.15.57:0/2635427198 >> 172.21.15.57:0/2635427198 conn(0x7fe9540948c0 msgr2=0x7fe95412cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:47:50.897 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.853+0000 7fe95b1df700 1 -- 172.21.15.57:0/2635427198 shutdown_connections 2023-03-03T07:47:50.898 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:50.853+0000 7fe95b1df700 1 -- 172.21.15.57:0/2635427198 wait complete. 2023-03-03T07:47:50.898 INFO:tasks.workunit.client.0.smithi057.stdout:+ return 0 2023-03-03T07:47:50.898 INFO:tasks.workunit.client.0.smithi057.stderr:+ grep complete /tmp/out__file 2023-03-03T07:47:50.898 INFO:tasks.workunit.client.0.smithi057.stdout:clone_8 in PENDING/IN-PROGRESS 2023-03-03T07:47:50.899 INFO:tasks.workunit.client.0.smithi057.stderr:+ echo clone_8 in PENDING/IN-PROGRESS 2023-03-03T07:47:50.899 INFO:tasks.workunit.client.0.smithi057.stderr:+ expect_failure sudo grep Traceback /tmp/error__file 2023-03-03T07:47:50.899 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo grep Traceback /tmp/error__file 2023-03-03T07:47:50.924 INFO:tasks.workunit.client.0.smithi057.stderr:+ return 0 2023-03-03T07:47:50.924 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo grep GLOBAL /home/ubuntu/cephtest/mnt.0/volumes/_nogroup/clone_8/.meta 2023-03-03T07:47:50.960 INFO:tasks.workunit.client.0.smithi057.stdout:[GLOBAL] 2023-03-03T07:47:50.964 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in $(eval echo {1..$NUM_CLONES}) 2023-03-03T07:47:50.965 INFO:tasks.workunit.client.0.smithi057.stderr:+ ignore_failure ceph fs clone status cephfs clone_9 2023-03-03T07:47:51.558 INFO:tasks.workunit.client.0.smithi057.stderr:+ cat /tmp/error__file 2023-03-03T07:47:51.565 INFO:tasks.workunit.client.0.smithi057.stdout:+ ceph fs clone status cephfs clone_9 2023-03-03T07:47:51.565 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.129+0000 7f7b7aea4700 1 Processor -- start 2023-03-03T07:47:51.565 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.129+0000 7f7b7aea4700 1 -- start start 2023-03-03T07:47:51.566 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.133+0000 7f7b7aea4700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7b74128570 0x7f7b7412a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:51.566 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.133+0000 7f7b7aea4700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b7408bf80 con 0x7f7b74071370 2023-03-03T07:47:51.566 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.133+0000 7f7b7aea4700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b7408c290 con 0x7f7b74128570 2023-03-03T07:47:51.566 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.133+0000 7f7b79ea2700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f7b74071370 0x7f7b74071740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:46602/0 (socket says 172.21.15.57:46602) 2023-03-03T07:47:51.566 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.133+0000 7f7b796a1700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7b74128570 0x7f7b7412a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:51.566 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.133+0000 7f7b79ea2700 1 -- 172.21.15.57:0/2399768479 learned_addr learned my addr 172.21.15.57:0/2399768479 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:47:51.566 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.133+0000 7f7b796a1700 1 -- 172.21.15.57:0/2399768479 >> v1:172.21.15.57:6789/0 conn(0x7f7b74071370 legacy=0x7f7b74071740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:51.567 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.133+0000 7f7b796a1700 1 -- 172.21.15.57:0/2399768479 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b7408c400 con 0x7f7b74128570 2023-03-03T07:47:51.567 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.133+0000 7f7b796a1700 1 --2- 172.21.15.57:0/2399768479 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b74128570 0x7f7b7412a950 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7b640097d0 tx=0x7f7b64009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbca5ec357003cd4 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:51.567 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.137+0000 7f7b78ea0700 1 -- 172.21.15.57:0/2399768479 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7b640041c0 con 0x7f7b74128570 2023-03-03T07:47:51.567 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.137+0000 7f7b78ea0700 1 -- 172.21.15.57:0/2399768479 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b64004320 con 0x7f7b74128570 2023-03-03T07:47:51.567 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.137+0000 7f7b78ea0700 1 -- 172.21.15.57:0/2399768479 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7b640036c0 con 0x7f7b74128570 2023-03-03T07:47:51.567 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.137+0000 7f7b7aea4700 1 -- 172.21.15.57:0/2399768479 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b74128570 msgr2=0x7f7b7412a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:51.567 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.137+0000 7f7b7aea4700 1 --2- 172.21.15.57:0/2399768479 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b74128570 0x7f7b7412a950 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7b640097d0 tx=0x7f7b64009ae0 comp rx=0 tx=0).stop 2023-03-03T07:47:51.567 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.137+0000 7f7b7aea4700 1 -- 172.21.15.57:0/2399768479 shutdown_connections 2023-03-03T07:47:51.568 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.137+0000 7f7b7aea4700 1 --2- 172.21.15.57:0/2399768479 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b74128570 0x7f7b7412a950 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:51.568 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.137+0000 7f7b7aea4700 1 -- 172.21.15.57:0/2399768479 >> 172.21.15.57:0/2399768479 conn(0x7f7b74094b00 msgr2=0x7f7b74094ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:47:51.568 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.137+0000 7f7b7aea4700 1 -- 172.21.15.57:0/2399768479 shutdown_connections 2023-03-03T07:47:51.568 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.137+0000 7f7b7aea4700 1 -- 172.21.15.57:0/2399768479 wait complete. 2023-03-03T07:47:51.568 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.141+0000 7f7b7aea4700 1 Processor -- start 2023-03-03T07:47:51.568 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.141+0000 7f7b7aea4700 1 -- start start 2023-03-03T07:47:51.568 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.141+0000 7f7b7aea4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b74071370 0x7f7b7408ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:51.569 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.141+0000 7f7b7aea4700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b74122740 con 0x7f7b74071370 2023-03-03T07:47:51.569 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.141+0000 7f7b79ea2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b74071370 0x7f7b7408ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:51.569 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.141+0000 7f7b79ea2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b74071370 0x7f7b7408ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56194/0 (socket says 172.21.15.57:56194) 2023-03-03T07:47:51.569 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.141+0000 7f7b79ea2700 1 -- 172.21.15.57:0/407603818 learned_addr learned my addr 172.21.15.57:0/407603818 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:47:51.569 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.141+0000 7f7b79ea2700 1 -- 172.21.15.57:0/407603818 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b640094b0 con 0x7f7b74071370 2023-03-03T07:47:51.569 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.141+0000 7f7b79ea2700 1 --2- 172.21.15.57:0/407603818 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b74071370 0x7f7b7408ca00 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7b7000c680 tx=0x7f7b7000ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:51.569 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.141+0000 7f7b627fc700 1 -- 172.21.15.57:0/407603818 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7b70005cc0 con 0x7f7b74071370 2023-03-03T07:47:51.570 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.145+0000 7f7b627fc700 1 -- 172.21.15.57:0/407603818 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b70005e20 con 0x7f7b74071370 2023-03-03T07:47:51.570 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.145+0000 7f7b7aea4700 1 -- 172.21.15.57:0/407603818 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b7412b230 con 0x7f7b74071370 2023-03-03T07:47:51.570 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.145+0000 7f7b627fc700 1 -- 172.21.15.57:0/407603818 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7b70007200 con 0x7f7b74071370 2023-03-03T07:47:51.570 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.145+0000 7f7b7aea4700 1 -- 172.21.15.57:0/407603818 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b7412b0a0 con 0x7f7b74071370 2023-03-03T07:47:51.570 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.145+0000 7f7b7aea4700 1 -- 172.21.15.57:0/407603818 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b7412b3c0 con 0x7f7b74071370 2023-03-03T07:47:51.570 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.145+0000 7f7b627fc700 1 -- 172.21.15.57:0/407603818 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 10) v1 ==== 42365+0+0 (secure 0 0 0) 0x7f7b70019030 con 0x7f7b74071370 2023-03-03T07:47:51.570 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.149+0000 7f7b627fc700 1 --2- 172.21.15.57:0/407603818 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f7b54034960 0x7f7b54036e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:51.570 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.149+0000 7f7b627fc700 1 -- 172.21.15.57:0/407603818 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 2928+0+0 (secure 0 0 0) 0x7f7b700456a0 con 0x7f7b74071370 2023-03-03T07:47:51.571 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.149+0000 7f7b627fc700 1 -- 172.21.15.57:0/407603818 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=38}) v3 -- 0x7f7b5403b200 con 0x7f7b74071370 2023-03-03T07:47:51.571 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.149+0000 7f7b796a1700 1 --2- 172.21.15.57:0/407603818 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f7b54034960 0x7f7b54036e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:51.571 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.149+0000 7f7b796a1700 1 --2- 172.21.15.57:0/407603818 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f7b54034960 0x7f7b54036e10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7b74126300 tx=0x7f7b64010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:51.571 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.153+0000 7f7b627fc700 1 -- 172.21.15.57:0/407603818 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7b70017030 con 0x7f7b74071370 2023-03-03T07:47:51.571 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.361+0000 7f7b7aea4700 1 -- 172.21.15.57:0/407603818 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_9", "target": ["mon-mgr", ""]}) v1 -- 0x7f7b74061a00 con 0x7f7b54034960 2023-03-03T07:47:51.571 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.377+0000 7f7b627fc700 1 -- 172.21.15.57:0/407603818 <== mgr.4099 v2:172.21.15.57:6808/28565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+149 (secure 0 0 0) 0x7f7b74061a00 con 0x7f7b54034960 2023-03-03T07:47:51.571 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.509+0000 7f7b7aea4700 1 -- 172.21.15.57:0/407603818 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 1: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_9", "target": ["mon-mgr", ""]}) v1 -- 0x7f7b7411fa30 con 0x7f7b54034960 2023-03-03T07:47:51.572 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.525+0000 7f7b627fc700 1 -- 172.21.15.57:0/407603818 <== mgr.4099 v2:172.21.15.57:6808/28565 2 ==== mgr_command_reply(tid 1: 0 ) v1 ==== 8+0+149 (secure 0 0 0) 0x7f7b7411fa30 con 0x7f7b54034960 2023-03-03T07:47:51.572 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.529+0000 7f7b7aea4700 1 -- 172.21.15.57:0/407603818 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f7b54034960 msgr2=0x7f7b54036e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:51.572 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.529+0000 7f7b7aea4700 1 --2- 172.21.15.57:0/407603818 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f7b54034960 0x7f7b54036e10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7b74126300 tx=0x7f7b64010000 comp rx=0 tx=0).stop 2023-03-03T07:47:51.572 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.529+0000 7f7b7aea4700 1 -- 172.21.15.57:0/407603818 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b74071370 msgr2=0x7f7b7408ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:51.572 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.529+0000 7f7b7aea4700 1 --2- 172.21.15.57:0/407603818 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b74071370 0x7f7b7408ca00 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7b7000c680 tx=0x7f7b7000ca40 comp rx=0 tx=0).stop 2023-03-03T07:47:51.572 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.529+0000 7f7b7aea4700 1 -- 172.21.15.57:0/407603818 shutdown_connections 2023-03-03T07:47:51.572 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.529+0000 7f7b7aea4700 1 --2- 172.21.15.57:0/407603818 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f7b54034960 0x7f7b54036e10 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:51.572 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.529+0000 7f7b7aea4700 1 --2- 172.21.15.57:0/407603818 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b74071370 0x7f7b7408ca00 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:51.573 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.529+0000 7f7b7aea4700 1 -- 172.21.15.57:0/407603818 >> 172.21.15.57:0/407603818 conn(0x7f7b74094b00 msgr2=0x7f7b7408ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:47:51.573 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.529+0000 7f7b7aea4700 1 -- 172.21.15.57:0/407603818 shutdown_connections 2023-03-03T07:47:51.573 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.529+0000 7f7b7aea4700 1 -- 172.21.15.57:0/407603818 wait complete. 2023-03-03T07:47:51.573 INFO:tasks.workunit.client.0.smithi057.stdout:+ return 0 2023-03-03T07:47:51.574 INFO:tasks.workunit.client.0.smithi057.stderr:+ grep complete /tmp/out__file 2023-03-03T07:47:51.574 INFO:tasks.workunit.client.0.smithi057.stdout:clone_9 in PENDING/IN-PROGRESS 2023-03-03T07:47:51.574 INFO:tasks.workunit.client.0.smithi057.stderr:+ echo clone_9 in PENDING/IN-PROGRESS 2023-03-03T07:47:51.575 INFO:tasks.workunit.client.0.smithi057.stderr:+ expect_failure sudo grep Traceback /tmp/error__file 2023-03-03T07:47:51.575 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo grep Traceback /tmp/error__file 2023-03-03T07:47:51.601 INFO:tasks.workunit.client.0.smithi057.stderr:+ return 0 2023-03-03T07:47:51.601 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo grep GLOBAL /home/ubuntu/cephtest/mnt.0/volumes/_nogroup/clone_9/.meta 2023-03-03T07:47:51.639 INFO:tasks.workunit.client.0.smithi057.stdout:[GLOBAL] 2023-03-03T07:47:51.644 INFO:tasks.workunit.client.0.smithi057.stderr:+ for i in $(eval echo {1..$NUM_CLONES}) 2023-03-03T07:47:51.644 INFO:tasks.workunit.client.0.smithi057.stderr:+ ignore_failure ceph fs clone status cephfs clone_10 2023-03-03T07:47:52.260 INFO:tasks.workunit.client.0.smithi057.stderr:+ cat /tmp/error__file 2023-03-03T07:47:52.265 INFO:tasks.workunit.client.0.smithi057.stdout:+ ceph fs clone status cephfs clone_10 2023-03-03T07:47:52.266 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.813+0000 7f52e1a1e700 1 Processor -- start 2023-03-03T07:47:52.266 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.813+0000 7f52e1a1e700 1 -- start start 2023-03-03T07:47:52.266 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.817+0000 7f52e1a1e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f52dc12ab20 0x7f52dc12cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:52.266 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.817+0000 7f52e1a1e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52dc08f8e0 con 0x7f52dc08e4c0 2023-03-03T07:47:52.266 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.817+0000 7f52e1a1e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52dc08f760 con 0x7f52dc12ab20 2023-03-03T07:47:52.266 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.817+0000 7f52e0a1c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f52dc08e4c0 0x7f52dc08e890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:46612/0 (socket says 172.21.15.57:46612) 2023-03-03T07:47:52.266 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.817+0000 7f52e0a1c700 1 -- 172.21.15.57:0/968687739 learned_addr learned my addr 172.21.15.57:0/968687739 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T07:47:52.267 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.817+0000 7f52dbfff700 1 --2- 172.21.15.57:0/968687739 >> v2:172.21.15.57:3300/0 conn(0x7f52dc12ab20 0x7f52dc12cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:52.267 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.817+0000 7f52db7fe700 1 -- 172.21.15.57:0/968687739 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2227936266 0 0) 0x7f52dc08f8e0 con 0x7f52dc08e4c0 2023-03-03T07:47:52.267 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.817+0000 7f52db7fe700 1 -- 172.21.15.57:0/968687739 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52c00035d0 con 0x7f52dc08e4c0 2023-03-03T07:47:52.267 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.817+0000 7f52dbfff700 1 -- 172.21.15.57:0/968687739 >> v1:172.21.15.57:6789/0 conn(0x7f52dc08e4c0 legacy=0x7f52dc08e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:52.267 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.817+0000 7f52dbfff700 1 -- 172.21.15.57:0/968687739 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52dc090650 con 0x7f52dc12ab20 2023-03-03T07:47:52.267 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.817+0000 7f52dbfff700 1 --2- 172.21.15.57:0/968687739 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52dc12ab20 0x7f52dc12cf00 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f52c80097d0 tx=0x7f52c8009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab18a1810fc66efb server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:52.267 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.817+0000 7f52db7fe700 1 -- 172.21.15.57:0/968687739 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f52c8004160 con 0x7f52dc12ab20 2023-03-03T07:47:52.268 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.817+0000 7f52db7fe700 1 -- 172.21.15.57:0/968687739 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c80042c0 con 0x7f52dc12ab20 2023-03-03T07:47:52.268 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.817+0000 7f52db7fe700 1 -- 172.21.15.57:0/968687739 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f52c80045a0 con 0x7f52dc12ab20 2023-03-03T07:47:52.268 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.821+0000 7f52e1a1e700 1 -- 172.21.15.57:0/968687739 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52dc12ab20 msgr2=0x7f52dc12cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:52.268 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.821+0000 7f52e1a1e700 1 --2- 172.21.15.57:0/968687739 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52dc12ab20 0x7f52dc12cf00 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f52c80097d0 tx=0x7f52c8009ae0 comp rx=0 tx=0).stop 2023-03-03T07:47:52.268 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.821+0000 7f52e1a1e700 1 -- 172.21.15.57:0/968687739 shutdown_connections 2023-03-03T07:47:52.268 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.821+0000 7f52e1a1e700 1 --2- 172.21.15.57:0/968687739 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52dc12ab20 0x7f52dc12cf00 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:52.268 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.821+0000 7f52e1a1e700 1 -- 172.21.15.57:0/968687739 >> 172.21.15.57:0/968687739 conn(0x7f52dc089fa0 msgr2=0x7f52dc08c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:47:52.269 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.821+0000 7f52e1a1e700 1 -- 172.21.15.57:0/968687739 shutdown_connections 2023-03-03T07:47:52.269 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.821+0000 7f52e1a1e700 1 -- 172.21.15.57:0/968687739 wait complete. 2023-03-03T07:47:52.269 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.825+0000 7f52e1a1e700 1 Processor -- start 2023-03-03T07:47:52.269 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.825+0000 7f52e1a1e700 1 -- start start 2023-03-03T07:47:52.270 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.825+0000 7f52e1a1e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52dc08e4c0 0x7f52dc1bc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:52.270 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.825+0000 7f52e1a1e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52dc122450 con 0x7f52dc08e4c0 2023-03-03T07:47:52.270 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.825+0000 7f52e0a1c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52dc08e4c0 0x7f52dc1bc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:52.270 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.825+0000 7f52e0a1c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52dc08e4c0 0x7f52dc1bc0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56222/0 (socket says 172.21.15.57:56222) 2023-03-03T07:47:52.271 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.825+0000 7f52e0a1c700 1 -- 172.21.15.57:0/3483782431 learned_addr learned my addr 172.21.15.57:0/3483782431 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T07:47:52.271 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.825+0000 7f52e0a1c700 1 -- 172.21.15.57:0/3483782431 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c80094b0 con 0x7f52dc08e4c0 2023-03-03T07:47:52.271 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.825+0000 7f52e0a1c700 1 --2- 172.21.15.57:0/3483782431 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52dc08e4c0 0x7f52dc1bc0a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f52d000c680 tx=0x7f52d000ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:52.271 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.829+0000 7f52d97fa700 1 -- 172.21.15.57:0/3483782431 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f52d0005cc0 con 0x7f52dc08e4c0 2023-03-03T07:47:52.272 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.829+0000 7f52d97fa700 1 -- 172.21.15.57:0/3483782431 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52d0005e20 con 0x7f52dc08e4c0 2023-03-03T07:47:52.272 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.829+0000 7f52d97fa700 1 -- 172.21.15.57:0/3483782431 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f52d0007220 con 0x7f52dc08e4c0 2023-03-03T07:47:52.272 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.829+0000 7f52e1a1e700 1 -- 172.21.15.57:0/3483782431 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52dc12d5d0 con 0x7f52dc08e4c0 2023-03-03T07:47:52.272 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.829+0000 7f52e1a1e700 1 -- 172.21.15.57:0/3483782431 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52dc12d440 con 0x7f52dc08e4c0 2023-03-03T07:47:52.272 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.829+0000 7f52e1a1e700 1 -- 172.21.15.57:0/3483782431 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52dc12d760 con 0x7f52dc08e4c0 2023-03-03T07:47:52.272 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.829+0000 7f52d97fa700 1 -- 172.21.15.57:0/3483782431 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 10) v1 ==== 42365+0+0 (secure 0 0 0) 0x7f52d0019030 con 0x7f52dc08e4c0 2023-03-03T07:47:52.273 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.833+0000 7f52d97fa700 1 --2- 172.21.15.57:0/3483782431 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f52c4034960 0x7f52c4036e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T07:47:52.273 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.833+0000 7f52d97fa700 1 -- 172.21.15.57:0/3483782431 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 2928+0+0 (secure 0 0 0) 0x7f52d00457a0 con 0x7f52dc08e4c0 2023-03-03T07:47:52.273 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.833+0000 7f52d97fa700 1 -- 172.21.15.57:0/3483782431 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=38}) v3 -- 0x7f52c403b200 con 0x7f52dc08e4c0 2023-03-03T07:47:52.273 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.833+0000 7f52dbfff700 1 --2- 172.21.15.57:0/3483782431 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f52c4034960 0x7f52c4036e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T07:47:52.273 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.833+0000 7f52dbfff700 1 --2- 172.21.15.57:0/3483782431 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f52c4034960 0x7f52c4036e10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f52dc092370 tx=0x7f52c8008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T07:47:52.273 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:51.837+0000 7f52d97fa700 1 -- 172.21.15.57:0/3483782431 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f52d0017070 con 0x7f52dc08e4c0 2023-03-03T07:47:52.274 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:52.057+0000 7f52e1a1e700 1 -- 172.21.15.57:0/3483782431 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_10", "target": ["mon-mgr", ""]}) v1 -- 0x7f52dc061a20 con 0x7f52c4034960 2023-03-03T07:47:52.274 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:52.073+0000 7f52d97fa700 1 -- 172.21.15.57:0/3483782431 <== mgr.4099 v2:172.21.15.57:6808/28565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+149 (secure 0 0 0) 0x7f52dc061a20 con 0x7f52c4034960 2023-03-03T07:47:52.274 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:52.213+0000 7f52e1a1e700 1 -- 172.21.15.57:0/3483782431 --> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] -- mgr_command(tid 1: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_10", "target": ["mon-mgr", ""]}) v1 -- 0x7f52dc118e80 con 0x7f52c4034960 2023-03-03T07:47:52.274 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:52.225+0000 7f52d97fa700 1 -- 172.21.15.57:0/3483782431 <== mgr.4099 v2:172.21.15.57:6808/28565 2 ==== mgr_command_reply(tid 1: 0 ) v1 ==== 8+0+149 (secure 0 0 0) 0x7f52dc118e80 con 0x7f52c4034960 2023-03-03T07:47:52.274 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:52.229+0000 7f52e1a1e700 1 -- 172.21.15.57:0/3483782431 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f52c4034960 msgr2=0x7f52c4036e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:52.274 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:52.229+0000 7f52e1a1e700 1 --2- 172.21.15.57:0/3483782431 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f52c4034960 0x7f52c4036e10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f52dc092370 tx=0x7f52c8008030 comp rx=0 tx=0).stop 2023-03-03T07:47:52.274 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:52.229+0000 7f52e1a1e700 1 -- 172.21.15.57:0/3483782431 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52dc08e4c0 msgr2=0x7f52dc1bc0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T07:47:52.274 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:52.229+0000 7f52e1a1e700 1 --2- 172.21.15.57:0/3483782431 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52dc08e4c0 0x7f52dc1bc0a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f52d000c680 tx=0x7f52d000ca40 comp rx=0 tx=0).stop 2023-03-03T07:47:52.275 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:52.229+0000 7f52e1a1e700 1 -- 172.21.15.57:0/3483782431 shutdown_connections 2023-03-03T07:47:52.275 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:52.229+0000 7f52e1a1e700 1 --2- 172.21.15.57:0/3483782431 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f52c4034960 0x7f52c4036e10 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:52.275 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:52.229+0000 7f52e1a1e700 1 --2- 172.21.15.57:0/3483782431 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52dc08e4c0 0x7f52dc1bc0a0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T07:47:52.275 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:52.229+0000 7f52e1a1e700 1 -- 172.21.15.57:0/3483782431 >> 172.21.15.57:0/3483782431 conn(0x7f52dc089fa0 msgr2=0x7f52dc124730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T07:47:52.275 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:52.229+0000 7f52e1a1e700 1 -- 172.21.15.57:0/3483782431 shutdown_connections 2023-03-03T07:47:52.275 INFO:tasks.workunit.client.0.smithi057.stdout:2023-03-03T07:47:52.229+0000 7f52e1a1e700 1 -- 172.21.15.57:0/3483782431 wait complete. 2023-03-03T07:47:52.275 INFO:tasks.workunit.client.0.smithi057.stdout:+ return 0 2023-03-03T07:47:52.276 INFO:tasks.workunit.client.0.smithi057.stderr:+ grep complete /tmp/out__file 2023-03-03T07:47:52.276 INFO:tasks.workunit.client.0.smithi057.stdout:clone_10 in PENDING/IN-PROGRESS 2023-03-03T07:47:52.276 INFO:tasks.workunit.client.0.smithi057.stderr:+ echo clone_10 in PENDING/IN-PROGRESS 2023-03-03T07:47:52.277 INFO:tasks.workunit.client.0.smithi057.stderr:+ expect_failure sudo grep Traceback /tmp/error__file 2023-03-03T07:47:52.277 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo grep Traceback /tmp/error__file 2023-03-03T07:47:52.301 INFO:tasks.workunit.client.0.smithi057.stderr:+ return 0 2023-03-03T07:47:52.301 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo grep GLOBAL /home/ubuntu/cephtest/mnt.0/volumes/_nogroup/clone_10/.meta 2023-03-03T07:47:52.337 INFO:tasks.workunit.client.0.smithi057.stdout:[GLOBAL] 2023-03-03T07:47:52.343 INFO:tasks.workunit.client.0.smithi057.stderr:+ ignore_failure sudo rm -rf '/home/ubuntu/cephtest/mnt.0/_index/clone/*' 2023-03-03T07:47:52.343 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo rm -rf '/home/ubuntu/cephtest/mnt.0/_index/clone/*' 2023-03-03T07:47:52.376 INFO:tasks.workunit.client.0.smithi057.stderr:+ return 0 2023-03-03T07:47:52.383 INFO:tasks.workunit.client.0.smithi057.stderr:+ ignore_failure sudo rm -rf /home/ubuntu/cephtest/mnt.0/volumes/_nogroup/clone_1 /home/ubuntu/cephtest/mnt.0/volumes/_nogroup/clone_10 /home/ubuntu/cephtest/mnt.0/volumes/_nogroup/clone_2 /home/ubuntu/cephtest/mnt.0/volumes/_nogroup/clone_3 /home/ubuntu/cephtest/mnt.0/volumes/_nogroup/clone_4 /home/ubuntu/cephtest/mnt.0/volumes/_nogroup/clone_5 /home/ubuntu/cephtest/mnt.0/volumes/_nogroup/clone_6 /home/ubuntu/cephtest/mnt.0/volumes/_nogroup/clone_7 /home/ubuntu/cephtest/mnt.0/volumes/_nogroup/clone_8 /home/ubuntu/cephtest/mnt.0/volumes/_nogroup/clone_9 2023-03-03T07:47:52.383 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo rm -rf /home/ubuntu/cephtest/mnt.0/volumes/_nogroup/clone_1 /home/ubuntu/cephtest/mnt.0/volumes/_nogroup/clone_10 /home/ubuntu/cephtest/mnt.0/volumes/_nogroup/clone_2 /home/ubuntu/cephtest/mnt.0/volumes/_nogroup/clone_3 /home/ubuntu/cephtest/mnt.0/volumes/_nogroup/clone_4 /home/ubuntu/cephtest/mnt.0/volumes/_nogroup/clone_5 /home/ubuntu/cephtest/mnt.0/volumes/_nogroup/clone_6 /home/ubuntu/cephtest/mnt.0/volumes/_nogroup/clone_7 /home/ubuntu/cephtest/mnt.0/volumes/_nogroup/clone_8 /home/ubuntu/cephtest/mnt.0/volumes/_nogroup/clone_9 2023-03-03T07:47:57.234 INFO:tasks.workunit.client.0.smithi057.stderr:+ return 0 2023-03-03T07:47:57.235 INFO:tasks.workunit.client.0.smithi057.stderr:+ ignore_failure sudo rmdir /home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/.snap/snap_0 2023-03-03T07:47:57.235 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo rmdir /home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0/.snap/snap_0 2023-03-03T07:47:57.290 INFO:tasks.workunit.client.0.smithi057.stderr:+ return 0 2023-03-03T07:47:57.291 INFO:tasks.workunit.client.0.smithi057.stderr:+ ignore_failure sudo rm -rf /home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0 2023-03-03T07:47:57.291 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo rm -rf /home/ubuntu/cephtest/mnt.0/volumes/_nogroup/sub_0 2023-03-03T07:47:57.352 INFO:tasks.ceph.mds.a.smithi057.stderr:2023-03-03T07:47:57.348+0000 7f1afefe3700 -1 mds.0.cache.den(0x605 10000000230) newly corrupt dentry to be committed: [dentry #0x100/stray5/10000000230 [4,head] auth NULL (dn xlock x=1 by 0x55c6e6c95c00) (dversion lock w=1 last_client=4251) pv=1151 v=1150 ap=2 ino=(nil) state=1342177281|new | request=1 lock=2 authpin=1 0x55c6e738c000] 2023-03-03T07:47:57.353 INFO:tasks.ceph.mds.a.smithi057.stderr:2023-03-03T07:47:57.348+0000 7f1afefe3700 -1 mds.0.damage notify_dentry Damage to dentries in fragment * of ino 0x605is fatal because it is a system directory for this rank 2023-03-03T07:47:57.888 INFO:tasks.ceph.mon.a.smithi057.stderr:2023-03-03T07:47:57.884+0000 7fcc0ddf9700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-03-03T07:47:57.889 INFO:tasks.ceph.mon.a.smithi057.stderr:2023-03-03T07:47:57.884+0000 7fcc0ddf9700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2023-03-03T07:47:57.938 INFO:tasks.ceph.mds.a.smithi057.stderr: -77> 2023-03-03T07:47:57.348+0000 7f1afefe3700 -1 mds.0.cache.den(0x605 10000000230) newly corrupt dentry to be committed: [dentry #0x100/stray5/10000000230 [4,head] auth NULL (dn xlock x=1 by 0x55c6e6c95c00) (dversion lock w=1 last_client=4251) pv=1151 v=1150 ap=2 ino=(nil) state=1342177281|new | request=1 lock=2 authpin=1 0x55c6e738c000] 2023-03-03T07:47:57.938 INFO:tasks.ceph.mds.a.smithi057.stderr: -75> 2023-03-03T07:47:57.348+0000 7f1afefe3700 -1 mds.0.damage notify_dentry Damage to dentries in fragment * of ino 0x605is fatal because it is a system directory for this rank 2023-03-03T07:47:58.013 INFO:tasks.ceph.mds.a.smithi057.stdout:starting mds.a at 2023-03-03T07:48:04.649 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:48:34.729 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:49:04.813 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:49:34.894 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:50:04.970 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:50:35.054 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:51:05.152 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:51:35.233 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:52:05.314 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:52:35.393 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:53:05.469 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:53:35.550 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:54:05.631 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:54:35.711 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:55:05.792 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:55:35.873 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:56:05.973 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:56:36.051 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:57:06.133 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:57:36.215 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:58:06.296 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:58:36.377 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:59:06.466 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:59:36.545 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:00:06.618 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:00:36.702 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:01:06.790 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:01:36.866 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:02:06.946 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:02:37.028 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:03:07.126 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:03:37.207 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:04:07.289 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:04:37.370 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:05:07.453 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:05:37.539 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:06:07.639 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:06:37.720 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:07:07.799 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:07:37.881 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:08:07.963 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:08:38.046 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:09:08.128 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:09:38.211 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:10:08.293 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:10:38.374 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:11:08.480 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:11:38.561 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:12:08.649 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:12:38.730 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:13:08.813 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:13:38.892 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:14:08.973 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:14:39.066 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:15:09.147 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:15:39.226 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:16:09.316 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:16:39.393 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:17:09.477 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:17:39.563 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:18:09.646 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:18:39.724 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:19:09.807 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:19:39.904 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:20:09.987 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:20:40.065 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:21:10.157 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:21:40.247 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:22:10.327 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:22:40.410 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:23:10.505 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:23:40.586 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:24:10.670 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:24:40.750 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:25:10.832 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:25:40.913 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:26:11.011 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:26:41.089 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:27:11.180 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:27:41.261 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:28:11.352 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:28:41.440 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:29:11.519 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:29:41.590 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:30:11.675 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:30:41.749 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:31:11.863 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:31:41.952 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:32:12.040 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:32:42.122 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:33:12.212 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:33:42.293 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:34:12.374 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:34:42.454 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:35:12.535 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:35:42.654 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:36:12.744 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:36:42.835 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:37:12.915 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:37:43.003 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:38:13.085 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:38:43.165 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:39:13.244 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:39:43.375 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:40:13.456 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:40:43.537 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:41:13.634 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:41:43.731 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:42:13.921 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:42:44.014 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:43:14.088 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:43:44.169 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:44:14.258 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:44:44.339 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:45:14.428 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:45:44.508 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:46:14.606 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:46:44.686 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:47:14.775 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:47:44.863 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:48:14.944 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:48:45.025 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:49:15.096 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:49:45.177 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:50:15.258 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:50:45.340 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:51:15.439 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:51:45.521 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:52:15.601 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:52:45.691 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:53:15.779 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:53:45.853 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:54:15.932 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:54:46.016 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:55:16.180 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:55:46.268 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:56:16.474 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:56:46.563 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:57:16.646 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:57:46.725 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:58:16.808 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:58:46.915 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:59:17.004 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:59:47.093 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:00:17.174 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:00:47.254 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:01:17.344 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:01:47.431 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:02:17.513 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:02:47.595 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:03:17.687 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:03:47.768 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:04:17.876 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:04:47.964 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:05:18.062 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:05:48.144 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:06:18.249 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:06:48.330 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:07:18.411 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:07:48.487 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:08:18.569 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:08:48.706 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:09:18.790 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:09:48.868 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:10:18.952 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:10:49.023 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:11:19.114 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:11:49.187 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:12:19.275 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:12:49.357 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:13:19.448 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:13:49.530 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:14:19.612 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:14:49.701 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:15:19.776 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:15:49.857 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:16:19.951 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:16:50.034 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:17:20.118 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:17:50.197 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:18:20.281 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:18:50.368 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:19:20.458 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:19:50.538 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:20:20.653 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:20:50.743 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:21:20.840 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:21:50.928 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:22:21.017 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:22:51.099 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:23:21.188 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:23:51.276 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:24:21.347 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:24:51.430 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:25:21.511 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:25:51.581 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:26:21.688 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:26:51.769 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:27:21.848 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:27:51.931 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:28:22.003 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:28:52.092 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:29:22.181 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:29:52.269 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:30:22.359 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:30:52.439 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:31:22.537 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:31:52.626 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:32:22.712 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:32:52.805 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:33:22.895 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:33:52.985 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:34:23.073 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:34:53.153 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:35:23.232 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:35:53.319 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:36:23.418 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:36:53.508 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:37:23.598 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:37:53.686 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:38:23.765 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:38:53.857 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:39:23.937 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:39:54.016 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:40:24.099 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:40:54.187 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:41:24.277 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:41:54.365 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:42:24.453 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:42:54.535 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:43:24.614 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:43:54.704 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:44:24.794 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:44:54.880 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:45:24.963 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:45:55.061 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:46:25.150 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:46:55.239 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:47:25.313 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:47:55.403 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:48:25.485 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:48:55.566 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:49:25.647 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:49:55.738 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:50:25.827 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:50:55.926 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:51:26.024 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:51:56.114 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:52:26.203 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:52:56.293 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:53:26.383 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:53:56.462 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:54:26.552 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:54:56.633 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:55:26.713 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:55:56.790 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:56:26.887 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:56:56.961 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:57:27.040 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:57:57.116 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:58:27.230 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:58:57.319 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:59:27.405 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:59:57.485 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:00:27.567 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:00:57.658 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:01:27.749 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:01:57.832 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:02:27.926 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:02:57.997 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:03:28.085 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:03:58.160 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:04:28.250 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:04:58.337 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:05:28.418 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:05:58.509 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:06:28.613 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:06:58.702 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:07:28.782 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:07:58.871 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:08:28.950 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:08:59.041 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:09:29.129 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:09:59.218 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:10:29.307 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:10:59.386 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:11:29.486 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:11:59.572 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:12:29.654 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:12:59.736 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:13:29.816 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:13:59.900 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:14:29.986 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:15:00.070 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:15:30.159 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:16:00.247 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:16:30.347 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:17:00.435 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:17:30.525 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:18:00.624 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:18:30.709 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:19:00.783 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:19:30.871 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:20:00.963 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:20:31.051 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:21:01.131 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:21:31.230 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:22:01.327 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:22:31.416 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:23:01.505 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:23:31.593 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:24:01.684 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:24:31.764 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:25:01.853 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:25:31.923 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:26:01.997 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:26:32.102 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:27:02.208 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:27:32.298 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:28:02.395 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:28:32.466 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:29:02.552 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:29:32.645 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:30:02.735 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:30:32.824 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:31:02.934 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:31:33.029 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:32:03.102 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:32:33.190 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:33:03.296 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:33:33.377 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:34:03.466 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:34:33.539 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:35:03.619 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:35:33.709 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:36:03.798 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:36:33.953 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:37:04.026 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:37:34.106 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:38:04.185 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:38:34.266 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:39:04.347 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:39:34.428 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:40:04.515 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:40:34.591 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:41:04.661 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:41:34.753 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:42:04.843 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:42:34.925 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:43:05.005 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:43:35.094 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:44:05.174 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:44:35.252 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:45:05.339 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:45:35.426 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:46:05.592 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:46:20.457 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-03-03T10:46:35.684 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:47:05.765 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:47:20.459 DEBUG:teuthology.orchestra.run:timed out waiting; will kill: 2023-03-03T10:47:35.848 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:48:05.931 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:48:20.460 DEBUG:teuthology.orchestra.run:timed out waiting; will kill: 2023-03-03T10:48:20.460 INFO:tasks.workunit:Stopping ['fs/full/subvolume_clone.sh'] on client.0... 2023-03-03T10:48:20.461 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-03-03T10:48:21.771 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/teuthology/run_tasks.py", line 103, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/teuthology/run_tasks.py", line 82, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_472aaef4ec3b3a2c29f73ca67854785a910f1f9b/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_472aaef4ec3b3a2c29f73ca67854785a910f1f9b/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/teuthology/orchestra/remote.py", line 525, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test fs/full/subvolume_clone.sh) on smithi057 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=472aaef4ec3b3a2c29f73ca67854785a910f1f9b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/full/subvolume_clone.sh' 2023-03-03T10:48:21.845 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=47b6dd980ed04914ba9e5a34d2cfdbb9 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/teuthology/run_tasks.py", line 103, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/teuthology/run_tasks.py", line 82, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_472aaef4ec3b3a2c29f73ca67854785a910f1f9b/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_472aaef4ec3b3a2c29f73ca67854785a910f1f9b/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/teuthology/orchestra/remote.py", line 525, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test fs/full/subvolume_clone.sh) on smithi057 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=472aaef4ec3b3a2c29f73ca67854785a910f1f9b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/full/subvolume_clone.sh' 2023-03-03T10:48:21.848 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-03-03T10:48:21.858 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-03-03T10:48:21.875 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-03-03T10:48:21.875 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-03T10:48:21.911 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-03-03T10:48:21.912 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-03T10:48:21.973 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T10:48:22.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.213+0000 7f7b50934700 1 Processor -- start 2023-03-03T10:48:22.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.213+0000 7f7b50934700 1 -- start start 2023-03-03T10:48:22.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.217+0000 7f7b50934700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7b4c123fa0 0x7f7b4c129bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T10:48:22.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.217+0000 7f7b50934700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b4c095ee0 con 0x7f7b4c06a790 2023-03-03T10:48:22.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.217+0000 7f7b50934700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b4c08af50 con 0x7f7b4c123fa0 2023-03-03T10:48:22.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.217+0000 7f7b4b7fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f7b4c06a790 0x7f7b4c123890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:41182/0 (socket says 172.21.15.57:41182) 2023-03-03T10:48:22.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.217+0000 7f7b4b7fe700 1 -- 172.21.15.57:0/1870447933 learned_addr learned my addr 172.21.15.57:0/1870447933 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T10:48:22.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.217+0000 7f7b4affd700 1 --2- 172.21.15.57:0/1870447933 >> v2:172.21.15.57:3300/0 conn(0x7f7b4c123fa0 0x7f7b4c129bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T10:48:22.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.217+0000 7f7b4affd700 1 -- 172.21.15.57:0/1870447933 >> v1:172.21.15.57:6789/0 conn(0x7f7b4c06a790 legacy=0x7f7b4c123890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T10:48:22.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.217+0000 7f7b4affd700 1 -- 172.21.15.57:0/1870447933 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b4c071300 con 0x7f7b4c123fa0 2023-03-03T10:48:22.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.217+0000 7f7b4affd700 1 --2- 172.21.15.57:0/1870447933 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b4c123fa0 0x7f7b4c129bc0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f7b4000a970 tx=0x7f7b4000ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=569ee24057b5c798 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T10:48:22.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.217+0000 7f7b4a7fc700 1 -- 172.21.15.57:0/1870447933 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7b4000c970 con 0x7f7b4c123fa0 2023-03-03T10:48:22.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.217+0000 7f7b4a7fc700 1 -- 172.21.15.57:0/1870447933 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b4000cad0 con 0x7f7b4c123fa0 2023-03-03T10:48:22.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.217+0000 7f7b4a7fc700 1 -- 172.21.15.57:0/1870447933 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7b4000cd90 con 0x7f7b4c123fa0 2023-03-03T10:48:22.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.221+0000 7f7b50934700 1 -- 172.21.15.57:0/1870447933 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b4c123fa0 msgr2=0x7f7b4c129bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T10:48:22.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.221+0000 7f7b50934700 1 --2- 172.21.15.57:0/1870447933 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b4c123fa0 0x7f7b4c129bc0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f7b4000a970 tx=0x7f7b4000ac80 comp rx=0 tx=0).stop 2023-03-03T10:48:22.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.221+0000 7f7b50934700 1 -- 172.21.15.57:0/1870447933 shutdown_connections 2023-03-03T10:48:22.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.221+0000 7f7b50934700 1 --2- 172.21.15.57:0/1870447933 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b4c123fa0 0x7f7b4c129bc0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T10:48:22.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.221+0000 7f7b50934700 1 -- 172.21.15.57:0/1870447933 >> 172.21.15.57:0/1870447933 conn(0x7f7b4c06c840 msgr2=0x7f7b4c06ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T10:48:22.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.221+0000 7f7b50934700 1 -- 172.21.15.57:0/1870447933 shutdown_connections 2023-03-03T10:48:22.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.221+0000 7f7b50934700 1 -- 172.21.15.57:0/1870447933 wait complete. 2023-03-03T10:48:22.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.221+0000 7f7b50934700 1 Processor -- start 2023-03-03T10:48:22.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.225+0000 7f7b50934700 1 -- start start 2023-03-03T10:48:22.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.225+0000 7f7b50934700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b4c06a790 0x7f7b4c094710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T10:48:22.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.225+0000 7f7b50934700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c125040 con 0x7f7b4c06a790 2023-03-03T10:48:22.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.225+0000 7f7b4b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b4c06a790 0x7f7b4c094710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T10:48:22.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.225+0000 7f7b4b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b4c06a790 0x7f7b4c094710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:54724/0 (socket says 172.21.15.57:54724) 2023-03-03T10:48:22.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.225+0000 7f7b4b7fe700 1 -- 172.21.15.57:0/1089731350 learned_addr learned my addr 172.21.15.57:0/1089731350 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T10:48:22.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.225+0000 7f7b4b7fe700 1 -- 172.21.15.57:0/1089731350 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b4000a650 con 0x7f7b4c06a790 2023-03-03T10:48:22.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.225+0000 7f7b4b7fe700 1 --2- 172.21.15.57:0/1089731350 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b4c06a790 0x7f7b4c094710 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c00c680 tx=0x7f7b3c00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T10:48:22.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.225+0000 7f7b33fff700 1 -- 172.21.15.57:0/1089731350 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7b3c005cc0 con 0x7f7b4c06a790 2023-03-03T10:48:22.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.225+0000 7f7b33fff700 1 -- 172.21.15.57:0/1089731350 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b3c005e20 con 0x7f7b4c06a790 2023-03-03T10:48:22.232 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.225+0000 7f7b33fff700 1 -- 172.21.15.57:0/1089731350 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7b3c007200 con 0x7f7b4c06a790 2023-03-03T10:48:22.232 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.225+0000 7f7b50934700 1 -- 172.21.15.57:0/1089731350 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b4c08a110 con 0x7f7b4c06a790 2023-03-03T10:48:22.232 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.225+0000 7f7b50934700 1 -- 172.21.15.57:0/1089731350 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b4c089f80 con 0x7f7b4c06a790 2023-03-03T10:48:22.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.229+0000 7f7b33fff700 1 -- 172.21.15.57:0/1089731350 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 12) v1 ==== 42285+0+0 (secure 0 0 0) 0x7f7b3c019030 con 0x7f7b4c06a790 2023-03-03T10:48:22.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.229+0000 7f7b50934700 1 -- 172.21.15.57:0/1089731350 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b4c124440 con 0x7f7b4c06a790 2023-03-03T10:48:22.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.229+0000 7f7b33fff700 1 --2- 172.21.15.57:0/1089731350 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f7b380348d0 0x7f7b38036d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T10:48:22.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.229+0000 7f7b33fff700 1 -- 172.21.15.57:0/1089731350 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3014+0+0 (secure 0 0 0) 0x7f7b3c0455a0 con 0x7f7b4c06a790 2023-03-03T10:48:22.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.229+0000 7f7b4affd700 1 --2- 172.21.15.57:0/1089731350 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f7b380348d0 0x7f7b38036d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T10:48:22.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.233+0000 7f7b4affd700 1 --2- 172.21.15.57:0/1089731350 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f7b380348d0 0x7f7b38036d80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7b4000acc0 tx=0x7f7b40012000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T10:48:22.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.237+0000 7f7b33fff700 1 -- 172.21.15.57:0/1089731350 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7b3c0198b0 con 0x7f7b4c06a790 2023-03-03T10:48:22.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.413+0000 7f7b50934700 1 -- 172.21.15.57:0/1089731350 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7b4c124d80 con 0x7f7b4c06a790 2023-03-03T10:48:22.422 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.417+0000 7f7b33fff700 1 -- 172.21.15.57:0/1089731350 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+9717 (secure 0 0 0) 0x7f7b3c017030 con 0x7f7b4c06a790 2023-03-03T10:48:22.422 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-03T10:48:22.423 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":39,"fsid":"5022d617-ad40-4ad9-8d5b-120958296d9c","created":"2023-03-03T07:43:13.256676+0000","modified":"2023-03-03T07:48:00.362886+0000","last_up_change":"2023-03-03T07:43:22.721740+0000","last_in_change":"2023-03-03T07:43:13.786190+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.60000002384185791,"backfillfull_ratio":0.55000001192092896,"nearfull_ratio":0.5,"cluster_snapshot":"","pool_max":4,"max_osd":1,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-03T07:43:22.864508+0000","flags":2049,"flags_names":"hashpspool,nearfull","type":1,"size":1,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":1,"score_stable":1,"optimal_score":1,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-03T07:43:28.091327+0000","flags":2049,"flags_names":"hashpspool,nearfull","type":1,"size":1,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1,"score_stable":1,"optimal_score":1,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-03T07:43:33.981804+0000","flags":2049,"flags_names":"hashpspool,nearfull","type":1,"size":1,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1,"score_stable":1,"optimal_score":1,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-03T07:43:35.408700+0000","flags":2049,"flags_names":"hashpspool,nearfull","type":1,"size":1,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1,"score_stable":1,"optimal_score":1,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d83f7ba7-9d9d-4309-95b9-2b8ad96f2f8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":6,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":28687},{"type":"v1","addr":"172.21.15.57:6801","nonce":28687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":28687},{"type":"v1","addr":"172.21.15.57:6803","nonce":28687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":28687},{"type":"v1","addr":"172.21.15.57:6807","nonce":28687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":28687},{"type":"v1","addr":"172.21.15.57:6805","nonce":28687}]},"public_addr":"172.21.15.57:6801/28687","cluster_addr":"172.21.15.57:6803/28687","heartbeat_back_addr":"172.21.15.57:6807/28687","heartbeat_front_addr":"172.21.15.57:6805/28687","state":["exists","nearfull","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T07:43:19.859898+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:6811/2058274046":"2023-03-04T07:47:57.352461+0000","172.21.15.57:6810/2058274046":"2023-03-04T07:47:57.352461+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T10:48:22.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.421+0000 7f7b50934700 1 -- 172.21.15.57:0/1089731350 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f7b380348d0 msgr2=0x7f7b38036d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T10:48:22.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.421+0000 7f7b50934700 1 --2- 172.21.15.57:0/1089731350 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f7b380348d0 0x7f7b38036d80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7b4000acc0 tx=0x7f7b40012000 comp rx=0 tx=0).stop 2023-03-03T10:48:22.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.421+0000 7f7b50934700 1 -- 172.21.15.57:0/1089731350 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b4c06a790 msgr2=0x7f7b4c094710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T10:48:22.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.421+0000 7f7b50934700 1 --2- 172.21.15.57:0/1089731350 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b4c06a790 0x7f7b4c094710 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c00c680 tx=0x7f7b3c00ca40 comp rx=0 tx=0).stop 2023-03-03T10:48:22.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.421+0000 7f7b50934700 1 -- 172.21.15.57:0/1089731350 shutdown_connections 2023-03-03T10:48:22.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.421+0000 7f7b50934700 1 --2- 172.21.15.57:0/1089731350 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f7b380348d0 0x7f7b38036d80 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T10:48:22.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.421+0000 7f7b50934700 1 --2- 172.21.15.57:0/1089731350 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b4c06a790 0x7f7b4c094710 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T10:48:22.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.421+0000 7f7b50934700 1 -- 172.21.15.57:0/1089731350 >> 172.21.15.57:0/1089731350 conn(0x7f7b4c06c840 msgr2=0x7f7b4c11b100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T10:48:22.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.421+0000 7f7b50934700 1 -- 172.21.15.57:0/1089731350 shutdown_connections 2023-03-03T10:48:22.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.421+0000 7f7b50934700 1 -- 172.21.15.57:0/1089731350 wait complete. 2023-03-03T10:48:22.458 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-03T07:43:22.864508+0000', 'flags': 2049, 'flags_names': 'hashpspool,nearfull', 'type': 1, 'size': 1, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 1, 'score_stable': 1, 'optimal_score': 1, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-03-03T07:43:28.091327+0000', 'flags': 2049, 'flags_names': 'hashpspool,nearfull', 'type': 1, 'size': 1, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1, 'score_stable': 1, 'optimal_score': 1, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-03T07:43:33.981804+0000', 'flags': 2049, 'flags_names': 'hashpspool,nearfull', 'type': 1, 'size': 1, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1, 'score_stable': 1, 'optimal_score': 1, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-03-03T07:43:35.408700+0000', 'flags': 2049, 'flags_names': 'hashpspool,nearfull', 'type': 1, 'size': 1, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1, 'score_stable': 1, 'optimal_score': 1, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-03T10:48:22.459 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-03T10:48:22.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.657+0000 7fab65c12700 1 Processor -- start 2023-03-03T10:48:22.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.657+0000 7fab65c12700 1 -- start start 2023-03-03T10:48:22.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.661+0000 7fab65c12700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fab60125f30 0x7fab6008ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T10:48:22.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.661+0000 7fab65c12700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab6008e360 con 0x7fab60125b60 2023-03-03T10:48:22.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.661+0000 7fab65c12700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab6008e590 con 0x7fab60125f30 2023-03-03T10:48:22.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.661+0000 7fab64c10700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fab60125b60 0x7fab6008a410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:41194/0 (socket says 172.21.15.57:41194) 2023-03-03T10:48:22.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.661+0000 7fab64c10700 1 -- 172.21.15.57:0/1052665803 learned_addr learned my addr 172.21.15.57:0/1052665803 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T10:48:22.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.661+0000 7fab5ffff700 1 --2- 172.21.15.57:0/1052665803 >> v2:172.21.15.57:3300/0 conn(0x7fab60125f30 0x7fab6008ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T10:48:22.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.661+0000 7fab5ffff700 1 -- 172.21.15.57:0/1052665803 >> v1:172.21.15.57:6789/0 conn(0x7fab60125b60 legacy=0x7fab6008a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T10:48:22.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.661+0000 7fab5f7fe700 1 -- 172.21.15.57:0/1052665803 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 152510493 0 0) 0x7fab6008e360 con 0x7fab60125b60 2023-03-03T10:48:22.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.661+0000 7fab5ffff700 1 -- 172.21.15.57:0/1052665803 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab601253b0 con 0x7fab60125f30 2023-03-03T10:48:22.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.661+0000 7fab5ffff700 1 --2- 172.21.15.57:0/1052665803 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab60125f30 0x7fab6008ab20 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fab4c0097d0 tx=0x7fab4c009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2d5f9b6f0a63ca7 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T10:48:22.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.661+0000 7fab5f7fe700 1 -- 172.21.15.57:0/1052665803 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fab4c0041c0 con 0x7fab60125f30 2023-03-03T10:48:22.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.661+0000 7fab5f7fe700 1 -- 172.21.15.57:0/1052665803 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4c004320 con 0x7fab60125f30 2023-03-03T10:48:22.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.661+0000 7fab5f7fe700 1 -- 172.21.15.57:0/1052665803 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fab4c0036c0 con 0x7fab60125f30 2023-03-03T10:48:22.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.665+0000 7fab65c12700 1 -- 172.21.15.57:0/1052665803 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab60125f30 msgr2=0x7fab6008ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T10:48:22.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.665+0000 7fab65c12700 1 --2- 172.21.15.57:0/1052665803 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab60125f30 0x7fab6008ab20 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fab4c0097d0 tx=0x7fab4c009ae0 comp rx=0 tx=0).stop 2023-03-03T10:48:22.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.665+0000 7fab65c12700 1 -- 172.21.15.57:0/1052665803 shutdown_connections 2023-03-03T10:48:22.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.665+0000 7fab65c12700 1 --2- 172.21.15.57:0/1052665803 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab60125f30 0x7fab6008ab20 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T10:48:22.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.665+0000 7fab65c12700 1 -- 172.21.15.57:0/1052665803 >> 172.21.15.57:0/1052665803 conn(0x7fab6006da50 msgr2=0x7fab6006fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T10:48:22.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.665+0000 7fab65c12700 1 -- 172.21.15.57:0/1052665803 shutdown_connections 2023-03-03T10:48:22.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.665+0000 7fab65c12700 1 -- 172.21.15.57:0/1052665803 wait complete. 2023-03-03T10:48:22.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.665+0000 7fab65c12700 1 Processor -- start 2023-03-03T10:48:22.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.665+0000 7fab65c12700 1 -- start start 2023-03-03T10:48:22.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.669+0000 7fab65c12700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab60125b60 0x7fab60121050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T10:48:22.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.669+0000 7fab65c12700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab60122a80 con 0x7fab60125b60 2023-03-03T10:48:22.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.669+0000 7fab64c10700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab60125b60 0x7fab60121050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T10:48:22.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.669+0000 7fab64c10700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab60125b60 0x7fab60121050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:54736/0 (socket says 172.21.15.57:54736) 2023-03-03T10:48:22.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.669+0000 7fab64c10700 1 -- 172.21.15.57:0/3090358845 learned_addr learned my addr 172.21.15.57:0/3090358845 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T10:48:22.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.669+0000 7fab64c10700 1 -- 172.21.15.57:0/3090358845 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab4c0094b0 con 0x7fab60125b60 2023-03-03T10:48:22.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.669+0000 7fab64c10700 1 --2- 172.21.15.57:0/3090358845 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab60125b60 0x7fab60121050 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fab5400c700 tx=0x7fab5400cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T10:48:22.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.669+0000 7fab5d7fa700 1 -- 172.21.15.57:0/3090358845 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fab54007410 con 0x7fab60125b60 2023-03-03T10:48:22.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.669+0000 7fab5d7fa700 1 -- 172.21.15.57:0/3090358845 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab54007570 con 0x7fab60125b60 2023-03-03T10:48:22.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.669+0000 7fab65c12700 1 -- 172.21.15.57:0/3090358845 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab6008b1f0 con 0x7fab60125b60 2023-03-03T10:48:22.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.669+0000 7fab5d7fa700 1 -- 172.21.15.57:0/3090358845 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fab54005850 con 0x7fab60125b60 2023-03-03T10:48:22.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.669+0000 7fab65c12700 1 -- 172.21.15.57:0/3090358845 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab6008b060 con 0x7fab60125b60 2023-03-03T10:48:22.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.673+0000 7fab65c12700 1 -- 172.21.15.57:0/3090358845 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab6008b380 con 0x7fab60125b60 2023-03-03T10:48:22.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.673+0000 7fab5d7fa700 1 -- 172.21.15.57:0/3090358845 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 12) v1 ==== 42285+0+0 (secure 0 0 0) 0x7fab54019030 con 0x7fab60125b60 2023-03-03T10:48:22.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.673+0000 7fab5d7fa700 1 --2- 172.21.15.57:0/3090358845 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fab44034870 0x7fab44036d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T10:48:22.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.673+0000 7fab5d7fa700 1 -- 172.21.15.57:0/3090358845 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3014+0+0 (secure 0 0 0) 0x7fab54045690 con 0x7fab60125b60 2023-03-03T10:48:22.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.673+0000 7fab5ffff700 1 --2- 172.21.15.57:0/3090358845 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fab44034870 0x7fab44036d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T10:48:22.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.677+0000 7fab5ffff700 1 --2- 172.21.15.57:0/3090358845 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fab44034870 0x7fab44036d20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fab4c014040 tx=0x7fab4c010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T10:48:22.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.681+0000 7fab5d7fa700 1 -- 172.21.15.57:0/3090358845 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fab540196d0 con 0x7fab60125b60 2023-03-03T10:48:22.856 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.853+0000 7fab65c12700 1 -- 172.21.15.57:0/3090358845 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fab600619b0 con 0x7fab60125b60 2023-03-03T10:48:22.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.853+0000 7fab5d7fa700 1 -- 172.21.15.57:0/3090358845 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7fab54017070 con 0x7fab60125b60 2023-03-03T10:48:22.857 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-03-03T10:48:22.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.853+0000 7fab65c12700 1 -- 172.21.15.57:0/3090358845 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fab44034870 msgr2=0x7fab44036d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T10:48:22.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.853+0000 7fab65c12700 1 --2- 172.21.15.57:0/3090358845 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fab44034870 0x7fab44036d20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fab4c014040 tx=0x7fab4c010000 comp rx=0 tx=0).stop 2023-03-03T10:48:22.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.853+0000 7fab65c12700 1 -- 172.21.15.57:0/3090358845 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab60125b60 msgr2=0x7fab60121050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T10:48:22.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.853+0000 7fab65c12700 1 --2- 172.21.15.57:0/3090358845 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab60125b60 0x7fab60121050 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fab5400c700 tx=0x7fab5400cac0 comp rx=0 tx=0).stop 2023-03-03T10:48:22.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.857+0000 7fab65c12700 1 -- 172.21.15.57:0/3090358845 shutdown_connections 2023-03-03T10:48:22.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.857+0000 7fab65c12700 1 --2- 172.21.15.57:0/3090358845 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fab44034870 0x7fab44036d20 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T10:48:22.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.857+0000 7fab65c12700 1 --2- 172.21.15.57:0/3090358845 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab60125b60 0x7fab60121050 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T10:48:22.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.857+0000 7fab65c12700 1 -- 172.21.15.57:0/3090358845 >> 172.21.15.57:0/3090358845 conn(0x7fab6006da50 msgr2=0x7fab6012a910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T10:48:22.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.857+0000 7fab65c12700 1 -- 172.21.15.57:0/3090358845 shutdown_connections 2023-03-03T10:48:22.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:22.857+0000 7fab65c12700 1 -- 172.21.15.57:0/3090358845 wait complete. 2023-03-03T10:48:22.895 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-03T10:48:23.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.097+0000 7f1c4d3df700 1 Processor -- start 2023-03-03T10:48:23.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.097+0000 7f1c4d3df700 1 -- start start 2023-03-03T10:48:23.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.097+0000 7f1c4d3df700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1c48127d80 0x7f1c48128150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T10:48:23.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.097+0000 7f1c4d3df700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c4808e470 con 0x7f1c481266d0 2023-03-03T10:48:23.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.101+0000 7f1c4d3df700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c4808e6a0 con 0x7f1c48127d80 2023-03-03T10:48:23.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.101+0000 7f1c47fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1c48127d80 0x7f1c48128150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T10:48:23.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.101+0000 7f1c3ffff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f1c481266d0 0x7f1c48126b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:41200/0 (socket says 172.21.15.57:41200) 2023-03-03T10:48:23.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.101+0000 7f1c3ffff700 1 -- 172.21.15.57:0/1391770775 learned_addr learned my addr 172.21.15.57:0/1391770775 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T10:48:23.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.101+0000 7f1c47fff700 1 -- 172.21.15.57:0/1391770775 >> v1:172.21.15.57:6789/0 conn(0x7f1c481266d0 legacy=0x7f1c48126b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T10:48:23.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.101+0000 7f1c47fff700 1 -- 172.21.15.57:0/1391770775 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c48128690 con 0x7f1c48127d80 2023-03-03T10:48:23.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.101+0000 7f1c47fff700 1 --2- 172.21.15.57:0/1391770775 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c48127d80 0x7f1c48128150 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f1c38009de0 tx=0x7f1c3800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0f35f036ffba855 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T10:48:23.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.101+0000 7f1c477fe700 1 -- 172.21.15.57:0/1391770775 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c3800e070 con 0x7f1c48127d80 2023-03-03T10:48:23.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.101+0000 7f1c477fe700 1 -- 172.21.15.57:0/1391770775 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c38003b70 con 0x7f1c48127d80 2023-03-03T10:48:23.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.101+0000 7f1c477fe700 1 -- 172.21.15.57:0/1391770775 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c38003e50 con 0x7f1c48127d80 2023-03-03T10:48:23.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.101+0000 7f1c4d3df700 1 -- 172.21.15.57:0/1391770775 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c48127d80 msgr2=0x7f1c48128150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T10:48:23.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.101+0000 7f1c4d3df700 1 --2- 172.21.15.57:0/1391770775 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c48127d80 0x7f1c48128150 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f1c38009de0 tx=0x7f1c3800b330 comp rx=0 tx=0).stop 2023-03-03T10:48:23.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.105+0000 7f1c4d3df700 1 -- 172.21.15.57:0/1391770775 shutdown_connections 2023-03-03T10:48:23.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.105+0000 7f1c4d3df700 1 --2- 172.21.15.57:0/1391770775 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c48127d80 0x7f1c48128150 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T10:48:23.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.105+0000 7f1c4d3df700 1 -- 172.21.15.57:0/1391770775 >> 172.21.15.57:0/1391770775 conn(0x7f1c4806ba50 msgr2=0x7f1c4806de60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T10:48:23.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.105+0000 7f1c4d3df700 1 -- 172.21.15.57:0/1391770775 shutdown_connections 2023-03-03T10:48:23.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.105+0000 7f1c4d3df700 1 -- 172.21.15.57:0/1391770775 wait complete. 2023-03-03T10:48:23.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.105+0000 7f1c4d3df700 1 Processor -- start 2023-03-03T10:48:23.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.105+0000 7f1c4d3df700 1 -- start start 2023-03-03T10:48:23.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.109+0000 7f1c4d3df700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c481266d0 0x7f1c481bbe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T10:48:23.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.109+0000 7f1c4d3df700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4808ecb0 con 0x7f1c481266d0 2023-03-03T10:48:23.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.109+0000 7f1c47fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c481266d0 0x7f1c481bbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T10:48:23.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.109+0000 7f1c47fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c481266d0 0x7f1c481bbe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:54762/0 (socket says 172.21.15.57:54762) 2023-03-03T10:48:23.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.109+0000 7f1c47fff700 1 -- 172.21.15.57:0/3433160919 learned_addr learned my addr 172.21.15.57:0/3433160919 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T10:48:23.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.109+0000 7f1c47fff700 1 -- 172.21.15.57:0/3433160919 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c38009a70 con 0x7f1c481266d0 2023-03-03T10:48:23.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.109+0000 7f1c47fff700 1 --2- 172.21.15.57:0/3433160919 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c481266d0 0x7f1c481bbe90 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1c3800b370 tx=0x7f1c38004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T10:48:23.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.109+0000 7f1c457fa700 1 -- 172.21.15.57:0/3433160919 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c380046f0 con 0x7f1c481266d0 2023-03-03T10:48:23.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.109+0000 7f1c457fa700 1 -- 172.21.15.57:0/3433160919 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c38004850 con 0x7f1c481266d0 2023-03-03T10:48:23.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.109+0000 7f1c457fa700 1 -- 172.21.15.57:0/3433160919 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c38012430 con 0x7f1c481266d0 2023-03-03T10:48:23.116 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.109+0000 7f1c4d3df700 1 -- 172.21.15.57:0/3433160919 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c48127240 con 0x7f1c481266d0 2023-03-03T10:48:23.116 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.109+0000 7f1c4d3df700 1 -- 172.21.15.57:0/3433160919 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c48127860 con 0x7f1c481266d0 2023-03-03T10:48:23.117 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.113+0000 7f1c457fa700 1 -- 172.21.15.57:0/3433160919 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 12) v1 ==== 42285+0+0 (secure 0 0 0) 0x7f1c38012620 con 0x7f1c481266d0 2023-03-03T10:48:23.117 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.113+0000 7f1c4d3df700 1 -- 172.21.15.57:0/3433160919 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c481273d0 con 0x7f1c481266d0 2023-03-03T10:48:23.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.113+0000 7f1c457fa700 1 --2- 172.21.15.57:0/3433160919 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f1c30034880 0x7f1c30036d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T10:48:23.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.113+0000 7f1c457fa700 1 -- 172.21.15.57:0/3433160919 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3014+0+0 (secure 0 0 0) 0x7f1c380487a0 con 0x7f1c481266d0 2023-03-03T10:48:23.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.113+0000 7f1c3ffff700 1 --2- 172.21.15.57:0/3433160919 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f1c30034880 0x7f1c30036d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T10:48:23.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.113+0000 7f1c3ffff700 1 --2- 172.21.15.57:0/3433160919 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f1c30034880 0x7f1c30036d30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1c34000f60 tx=0x7f1c34007b30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T10:48:23.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.121+0000 7f1c457fa700 1 -- 172.21.15.57:0/3433160919 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1c3801ce10 con 0x7f1c481266d0 2023-03-03T10:48:23.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.289+0000 7f1c4d3df700 1 -- 172.21.15.57:0/3433160919 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1c4808edf0 con 0x7f1c481266d0 2023-03-03T10:48:23.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.289+0000 7f1c457fa700 1 -- 172.21.15.57:0/3433160919 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v39) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1c3801c3b0 con 0x7f1c481266d0 2023-03-03T10:48:23.296 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2023-03-03T10:48:23.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.293+0000 7f1c4d3df700 1 -- 172.21.15.57:0/3433160919 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f1c30034880 msgr2=0x7f1c30036d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T10:48:23.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.293+0000 7f1c4d3df700 1 --2- 172.21.15.57:0/3433160919 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f1c30034880 0x7f1c30036d30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1c34000f60 tx=0x7f1c34007b30 comp rx=0 tx=0).stop 2023-03-03T10:48:23.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.293+0000 7f1c4d3df700 1 -- 172.21.15.57:0/3433160919 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c481266d0 msgr2=0x7f1c481bbe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T10:48:23.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.293+0000 7f1c4d3df700 1 --2- 172.21.15.57:0/3433160919 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c481266d0 0x7f1c481bbe90 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1c3800b370 tx=0x7f1c38004af0 comp rx=0 tx=0).stop 2023-03-03T10:48:23.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.293+0000 7f1c4d3df700 1 -- 172.21.15.57:0/3433160919 shutdown_connections 2023-03-03T10:48:23.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.293+0000 7f1c4d3df700 1 --2- 172.21.15.57:0/3433160919 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f1c30034880 0x7f1c30036d30 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T10:48:23.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.293+0000 7f1c4d3df700 1 --2- 172.21.15.57:0/3433160919 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c481266d0 0x7f1c481bbe90 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T10:48:23.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.293+0000 7f1c4d3df700 1 -- 172.21.15.57:0/3433160919 >> 172.21.15.57:0/3433160919 conn(0x7f1c4806ba50 msgr2=0x7f1c4806cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T10:48:23.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.293+0000 7f1c4d3df700 1 -- 172.21.15.57:0/3433160919 shutdown_connections 2023-03-03T10:48:23.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.293+0000 7f1c4d3df700 1 -- 172.21.15.57:0/3433160919 wait complete. 2023-03-03T10:48:23.331 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-03T10:48:23.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.537+0000 7f8ac90c4700 1 Processor -- start 2023-03-03T10:48:23.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.537+0000 7f8ac90c4700 1 -- start start 2023-03-03T10:48:23.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.537+0000 7f8ac90c4700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8ac4127140 0x7f8ac4129520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T10:48:23.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.537+0000 7f8ac90c4700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ac4096e60 con 0x7f8ac408ae70 2023-03-03T10:48:23.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.537+0000 7f8ac90c4700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ac408c960 con 0x7f8ac4127140 2023-03-03T10:48:23.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.541+0000 7f8abbfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8ac4127140 0x7f8ac4129520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T10:48:23.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.541+0000 7f8ac3fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f8ac408ae70 0x7f8ac408b240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:41210/0 (socket says 172.21.15.57:41210) 2023-03-03T10:48:23.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.541+0000 7f8abbfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8ac4127140 0x7f8ac4129520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:54774/0 (socket says 172.21.15.57:54774) 2023-03-03T10:48:23.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.541+0000 7f8ac3fff700 1 -- 172.21.15.57:0/1822085610 learned_addr learned my addr 172.21.15.57:0/1822085610 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T10:48:23.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.541+0000 7f8abbfff700 1 -- 172.21.15.57:0/1822085610 >> v1:172.21.15.57:6789/0 conn(0x7f8ac408ae70 legacy=0x7f8ac408b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T10:48:23.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.541+0000 7f8ac37fe700 1 -- 172.21.15.57:0/1822085610 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 787863565 0 0) 0x7f8ac4096e60 con 0x7f8ac408ae70 2023-03-03T10:48:23.547 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.541+0000 7f8abbfff700 1 -- 172.21.15.57:0/1822085610 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac408cc70 con 0x7f8ac4127140 2023-03-03T10:48:23.547 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.541+0000 7f8abbfff700 1 --2- 172.21.15.57:0/1822085610 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ac4127140 0x7f8ac4129520 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8aac0097d0 tx=0x7f8aac009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77acf4fc195d87d8 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T10:48:23.547 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.541+0000 7f8ac37fe700 1 -- 172.21.15.57:0/1822085610 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8aac0041c0 con 0x7f8ac4127140 2023-03-03T10:48:23.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.541+0000 7f8ac37fe700 1 -- 172.21.15.57:0/1822085610 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aac004320 con 0x7f8ac4127140 2023-03-03T10:48:23.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.541+0000 7f8ac37fe700 1 -- 172.21.15.57:0/1822085610 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8aac0036c0 con 0x7f8ac4127140 2023-03-03T10:48:23.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.545+0000 7f8ac90c4700 1 -- 172.21.15.57:0/1822085610 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ac4127140 msgr2=0x7f8ac4129520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T10:48:23.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.545+0000 7f8ac90c4700 1 --2- 172.21.15.57:0/1822085610 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ac4127140 0x7f8ac4129520 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8aac0097d0 tx=0x7f8aac009ae0 comp rx=0 tx=0).stop 2023-03-03T10:48:23.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.545+0000 7f8ac90c4700 1 -- 172.21.15.57:0/1822085610 shutdown_connections 2023-03-03T10:48:23.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.545+0000 7f8ac90c4700 1 --2- 172.21.15.57:0/1822085610 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ac4127140 0x7f8ac4129520 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T10:48:23.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.545+0000 7f8ac90c4700 1 -- 172.21.15.57:0/1822085610 >> 172.21.15.57:0/1822085610 conn(0x7f8ac406da50 msgr2=0x7f8ac406fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T10:48:23.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.545+0000 7f8ac90c4700 1 -- 172.21.15.57:0/1822085610 shutdown_connections 2023-03-03T10:48:23.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.545+0000 7f8ac90c4700 1 -- 172.21.15.57:0/1822085610 wait complete. 2023-03-03T10:48:23.551 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.545+0000 7f8ac90c4700 1 Processor -- start 2023-03-03T10:48:23.551 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.545+0000 7f8ac90c4700 1 -- start start 2023-03-03T10:48:23.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.549+0000 7f8ac90c4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ac408ae70 0x7f8ac411ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T10:48:23.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.549+0000 7f8ac90c4700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac411fc20 con 0x7f8ac408ae70 2023-03-03T10:48:23.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.549+0000 7f8ac3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ac408ae70 0x7f8ac411ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T10:48:23.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.549+0000 7f8ac3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ac408ae70 0x7f8ac411ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:54780/0 (socket says 172.21.15.57:54780) 2023-03-03T10:48:23.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.549+0000 7f8ac3fff700 1 -- 172.21.15.57:0/213299057 learned_addr learned my addr 172.21.15.57:0/213299057 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T10:48:23.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.549+0000 7f8ac3fff700 1 -- 172.21.15.57:0/213299057 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aac0094b0 con 0x7f8ac408ae70 2023-03-03T10:48:23.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.549+0000 7f8ac3fff700 1 --2- 172.21.15.57:0/213299057 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ac408ae70 0x7f8ac411ea40 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f8ab400c6d0 tx=0x7f8ab400ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T10:48:23.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.549+0000 7f8ac17fa700 1 -- 172.21.15.57:0/213299057 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ab4007410 con 0x7f8ac408ae70 2023-03-03T10:48:23.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.549+0000 7f8ac17fa700 1 -- 172.21.15.57:0/213299057 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab4007570 con 0x7f8ac408ae70 2023-03-03T10:48:23.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.549+0000 7f8ac90c4700 1 -- 172.21.15.57:0/213299057 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ac4129a60 con 0x7f8ac408ae70 2023-03-03T10:48:23.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.549+0000 7f8ac17fa700 1 -- 172.21.15.57:0/213299057 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ab4005850 con 0x7f8ac408ae70 2023-03-03T10:48:23.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.549+0000 7f8ac90c4700 1 -- 172.21.15.57:0/213299057 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ac408b950 con 0x7f8ac408ae70 2023-03-03T10:48:23.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.553+0000 7f8ac17fa700 1 -- 172.21.15.57:0/213299057 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 12) v1 ==== 42285+0+0 (secure 0 0 0) 0x7f8ab4019030 con 0x7f8ac408ae70 2023-03-03T10:48:23.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.553+0000 7f8ac90c4700 1 -- 172.21.15.57:0/213299057 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ac4129bf0 con 0x7f8ac408ae70 2023-03-03T10:48:23.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.553+0000 7f8ac17fa700 1 --2- 172.21.15.57:0/213299057 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f8aa40348d0 0x7f8aa4036d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T10:48:23.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.553+0000 7f8ac17fa700 1 -- 172.21.15.57:0/213299057 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3014+0+0 (secure 0 0 0) 0x7f8ab4045690 con 0x7f8ac408ae70 2023-03-03T10:48:23.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.553+0000 7f8abbfff700 1 --2- 172.21.15.57:0/213299057 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f8aa40348d0 0x7f8aa4036d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T10:48:23.559 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.553+0000 7f8abbfff700 1 --2- 172.21.15.57:0/213299057 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f8aa40348d0 0x7f8aa4036d80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8aac014040 tx=0x7f8aac010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T10:48:23.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.561+0000 7f8ac17fa700 1 -- 172.21.15.57:0/213299057 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8ab40196b0 con 0x7f8ac408ae70 2023-03-03T10:48:23.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.737+0000 7f8ac90c4700 1 -- 172.21.15.57:0/213299057 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8ac40619b0 con 0x7f8ac408ae70 2023-03-03T10:48:23.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.737+0000 7f8ac17fa700 1 -- 172.21.15.57:0/213299057 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v39) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8ab4017020 con 0x7f8ac408ae70 2023-03-03T10:48:23.742 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2023-03-03T10:48:23.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.741+0000 7f8ac90c4700 1 -- 172.21.15.57:0/213299057 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f8aa40348d0 msgr2=0x7f8aa4036d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T10:48:23.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.741+0000 7f8ac90c4700 1 --2- 172.21.15.57:0/213299057 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f8aa40348d0 0x7f8aa4036d80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8aac014040 tx=0x7f8aac010000 comp rx=0 tx=0).stop 2023-03-03T10:48:23.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.741+0000 7f8ac90c4700 1 -- 172.21.15.57:0/213299057 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ac408ae70 msgr2=0x7f8ac411ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T10:48:23.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.741+0000 7f8ac90c4700 1 --2- 172.21.15.57:0/213299057 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ac408ae70 0x7f8ac411ea40 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f8ab400c6d0 tx=0x7f8ab400ca90 comp rx=0 tx=0).stop 2023-03-03T10:48:23.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.741+0000 7f8ac90c4700 1 -- 172.21.15.57:0/213299057 shutdown_connections 2023-03-03T10:48:23.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.741+0000 7f8ac90c4700 1 --2- 172.21.15.57:0/213299057 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f8aa40348d0 0x7f8aa4036d80 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T10:48:23.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.741+0000 7f8ac90c4700 1 --2- 172.21.15.57:0/213299057 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ac408ae70 0x7f8ac411ea40 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T10:48:23.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.741+0000 7f8ac90c4700 1 -- 172.21.15.57:0/213299057 >> 172.21.15.57:0/213299057 conn(0x7f8ac406da50 msgr2=0x7f8ac406e710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T10:48:23.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.741+0000 7f8ac90c4700 1 -- 172.21.15.57:0/213299057 shutdown_connections 2023-03-03T10:48:23.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.741+0000 7f8ac90c4700 1 -- 172.21.15.57:0/213299057 wait complete. 2023-03-03T10:48:23.780 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-03T10:48:23.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.981+0000 7f936744c700 1 Processor -- start 2023-03-03T10:48:23.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.985+0000 7f936744c700 1 -- start start 2023-03-03T10:48:23.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.985+0000 7f936744c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9360123970 0x7f9360123d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T10:48:23.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.985+0000 7f936744c700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9360124280 con 0x7f936010ed50 2023-03-03T10:48:23.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.985+0000 7f936744c700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9360112460 con 0x7f9360123970 2023-03-03T10:48:23.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.985+0000 7f936644a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9360123970 0x7f9360123d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T10:48:23.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.985+0000 7f936644a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9360123970 0x7f9360123d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:54792/0 (socket says 172.21.15.57:54792) 2023-03-03T10:48:23.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.985+0000 7f936644a700 1 -- 172.21.15.57:0/1294804800 learned_addr learned my addr 172.21.15.57:0/1294804800 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T10:48:23.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.985+0000 7f9365c49700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f936010ed50 0x7f936010f1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:41222/0 (socket says 172.21.15.57:41222) 2023-03-03T10:48:23.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.985+0000 7f936644a700 1 -- 172.21.15.57:0/1294804800 >> v1:172.21.15.57:6789/0 conn(0x7f936010ed50 legacy=0x7f936010f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T10:48:23.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.985+0000 7f936644a700 1 -- 172.21.15.57:0/1294804800 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9360112650 con 0x7f9360123970 2023-03-03T10:48:23.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.989+0000 7f936644a700 1 --2- 172.21.15.57:0/1294804800 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9360123970 0x7f9360123d40 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f935c009ea0 tx=0x7f935c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37a2e3d96faee5bd server_cookie=0 in_seq=0 out_seq=0 2023-03-03T10:48:23.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.989+0000 7f9365448700 1 -- 172.21.15.57:0/1294804800 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f935c00e070 con 0x7f9360123970 2023-03-03T10:48:23.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.989+0000 7f9365448700 1 -- 172.21.15.57:0/1294804800 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f935c003a40 con 0x7f9360123970 2023-03-03T10:48:23.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.989+0000 7f9365448700 1 -- 172.21.15.57:0/1294804800 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f935c003d00 con 0x7f9360123970 2023-03-03T10:48:23.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.989+0000 7f936744c700 1 -- 172.21.15.57:0/1294804800 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9360123970 msgr2=0x7f9360123d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T10:48:23.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.989+0000 7f936744c700 1 --2- 172.21.15.57:0/1294804800 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9360123970 0x7f9360123d40 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f935c009ea0 tx=0x7f935c00b330 comp rx=0 tx=0).stop 2023-03-03T10:48:23.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.989+0000 7f936744c700 1 -- 172.21.15.57:0/1294804800 shutdown_connections 2023-03-03T10:48:23.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.989+0000 7f936744c700 1 --2- 172.21.15.57:0/1294804800 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9360123970 0x7f9360123d40 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T10:48:23.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.989+0000 7f936744c700 1 -- 172.21.15.57:0/1294804800 >> 172.21.15.57:0/1294804800 conn(0x7f936006e0f0 msgr2=0x7f9360070500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T10:48:23.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.989+0000 7f936744c700 1 -- 172.21.15.57:0/1294804800 shutdown_connections 2023-03-03T10:48:23.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.989+0000 7f936744c700 1 -- 172.21.15.57:0/1294804800 wait complete. 2023-03-03T10:48:23.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.993+0000 7f936744c700 1 Processor -- start 2023-03-03T10:48:23.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.993+0000 7f936744c700 1 -- start start 2023-03-03T10:48:24.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.997+0000 7f936744c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f936010ed50 0x7f93601bb090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T10:48:24.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.997+0000 7f936744c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93601b95f0 con 0x7f936010ed50 2023-03-03T10:48:24.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.997+0000 7f936644a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f936010ed50 0x7f93601bb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T10:48:24.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.997+0000 7f936644a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f936010ed50 0x7f93601bb090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:54804/0 (socket says 172.21.15.57:54804) 2023-03-03T10:48:24.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.997+0000 7f936644a700 1 -- 172.21.15.57:0/1084910999 learned_addr learned my addr 172.21.15.57:0/1084910999 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T10:48:24.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.997+0000 7f936644a700 1 -- 172.21.15.57:0/1084910999 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f935c009b30 con 0x7f936010ed50 2023-03-03T10:48:24.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.997+0000 7f936644a700 1 --2- 172.21.15.57:0/1084910999 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f936010ed50 0x7f93601bb090 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f936006ac40 tx=0x7f935c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T10:48:24.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.997+0000 7f9356ffd700 1 -- 172.21.15.57:0/1084910999 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f935c004370 con 0x7f936010ed50 2023-03-03T10:48:24.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.997+0000 7f9356ffd700 1 -- 172.21.15.57:0/1084910999 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f935c0044f0 con 0x7f936010ed50 2023-03-03T10:48:24.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.997+0000 7f936744c700 1 -- 172.21.15.57:0/1084910999 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9360123570 con 0x7f936010ed50 2023-03-03T10:48:24.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.997+0000 7f9356ffd700 1 -- 172.21.15.57:0/1084910999 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f935c0047d0 con 0x7f936010ed50 2023-03-03T10:48:24.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:23.997+0000 7f936744c700 1 -- 172.21.15.57:0/1084910999 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93601233e0 con 0x7f936010ed50 2023-03-03T10:48:24.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.001+0000 7f936744c700 1 -- 172.21.15.57:0/1084910999 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f936010f8e0 con 0x7f936010ed50 2023-03-03T10:48:24.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.001+0000 7f9356ffd700 1 -- 172.21.15.57:0/1084910999 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 12) v1 ==== 42285+0+0 (secure 0 0 0) 0x7f935c02c070 con 0x7f936010ed50 2023-03-03T10:48:24.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.001+0000 7f9356ffd700 1 --2- 172.21.15.57:0/1084910999 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f93440348d0 0x7f9344036d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T10:48:24.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.001+0000 7f9356ffd700 1 -- 172.21.15.57:0/1084910999 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3014+0+0 (secure 0 0 0) 0x7f935c047740 con 0x7f936010ed50 2023-03-03T10:48:24.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.001+0000 7f9365c49700 1 --2- 172.21.15.57:0/1084910999 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f93440348d0 0x7f9344036d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T10:48:24.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.005+0000 7f9365c49700 1 --2- 172.21.15.57:0/1084910999 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f93440348d0 0x7f9344036d80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9350001690 tx=0x7f9350007af0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T10:48:24.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.009+0000 7f9356ffd700 1 -- 172.21.15.57:0/1084910999 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f935c023dc0 con 0x7f936010ed50 2023-03-03T10:48:24.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.181+0000 7f936744c700 1 -- 172.21.15.57:0/1084910999 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f93600664c0 con 0x7f936010ed50 2023-03-03T10:48:24.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.181+0000 7f9356ffd700 1 -- 172.21.15.57:0/1084910999 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v39) v1 ==== 100+0+11 (secure 0 0 0) 0x7f935c017020 con 0x7f936010ed50 2023-03-03T10:48:24.187 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2023-03-03T10:48:24.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.185+0000 7f936744c700 1 -- 172.21.15.57:0/1084910999 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f93440348d0 msgr2=0x7f9344036d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T10:48:24.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.185+0000 7f936744c700 1 --2- 172.21.15.57:0/1084910999 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f93440348d0 0x7f9344036d80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9350001690 tx=0x7f9350007af0 comp rx=0 tx=0).stop 2023-03-03T10:48:24.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.185+0000 7f936744c700 1 -- 172.21.15.57:0/1084910999 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f936010ed50 msgr2=0x7f93601bb090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T10:48:24.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.185+0000 7f936744c700 1 --2- 172.21.15.57:0/1084910999 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f936010ed50 0x7f93601bb090 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f936006ac40 tx=0x7f935c004af0 comp rx=0 tx=0).stop 2023-03-03T10:48:24.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.185+0000 7f936744c700 1 -- 172.21.15.57:0/1084910999 shutdown_connections 2023-03-03T10:48:24.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.185+0000 7f936744c700 1 --2- 172.21.15.57:0/1084910999 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f93440348d0 0x7f9344036d80 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T10:48:24.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.185+0000 7f936744c700 1 --2- 172.21.15.57:0/1084910999 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f936010ed50 0x7f93601bb090 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T10:48:24.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.185+0000 7f936744c700 1 -- 172.21.15.57:0/1084910999 >> 172.21.15.57:0/1084910999 conn(0x7f936006e0f0 msgr2=0x7f936006fd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T10:48:24.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.185+0000 7f936744c700 1 -- 172.21.15.57:0/1084910999 shutdown_connections 2023-03-03T10:48:24.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.185+0000 7f936744c700 1 -- 172.21.15.57:0/1084910999 wait complete. 2023-03-03T10:48:24.222 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-03-03T10:48:24.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.425+0000 7f008a128700 1 Processor -- start 2023-03-03T10:48:24.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.425+0000 7f008a128700 1 -- start start 2023-03-03T10:48:24.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.425+0000 7f008a128700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f008408a6c0 0x7f008408aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T10:48:24.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.425+0000 7f008a128700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0084095ee0 con 0x7f008406a790 2023-03-03T10:48:24.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.425+0000 7f008a128700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f008408b790 con 0x7f008408a6c0 2023-03-03T10:48:24.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.425+0000 7f0088925700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f008406a790 0x7f0084123890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:41224/0 (socket says 172.21.15.57:41224) 2023-03-03T10:48:24.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.425+0000 7f0088925700 1 -- 172.21.15.57:0/433926214 learned_addr learned my addr 172.21.15.57:0/433926214 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T10:48:24.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.425+0000 7f0089126700 1 --2- 172.21.15.57:0/433926214 >> v2:172.21.15.57:3300/0 conn(0x7f008408a6c0 0x7f008408aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T10:48:24.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.425+0000 7f0089126700 1 -- 172.21.15.57:0/433926214 >> v1:172.21.15.57:6789/0 conn(0x7f008406a790 legacy=0x7f0084123890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T10:48:24.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.425+0000 7f0089126700 1 -- 172.21.15.57:0/433926214 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0084071300 con 0x7f008408a6c0 2023-03-03T10:48:24.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.425+0000 7f007bfff700 1 -- 172.21.15.57:0/433926214 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3237683101 0 0) 0x7f0084095ee0 con 0x7f008406a790 2023-03-03T10:48:24.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.429+0000 7f0089126700 1 --2- 172.21.15.57:0/433926214 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f008408a6c0 0x7f008408aa90 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f00800097d0 tx=0x7f0080009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5554007b268872ad server_cookie=0 in_seq=0 out_seq=0 2023-03-03T10:48:24.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.429+0000 7f007bfff700 1 -- 172.21.15.57:0/433926214 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f00800041c0 con 0x7f008408a6c0 2023-03-03T10:48:24.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.429+0000 7f007bfff700 1 -- 172.21.15.57:0/433926214 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0080004320 con 0x7f008408a6c0 2023-03-03T10:48:24.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.429+0000 7f007bfff700 1 -- 172.21.15.57:0/433926214 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f00800036c0 con 0x7f008408a6c0 2023-03-03T10:48:24.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.429+0000 7f008a128700 1 -- 172.21.15.57:0/433926214 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f008408a6c0 msgr2=0x7f008408aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T10:48:24.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.429+0000 7f008a128700 1 --2- 172.21.15.57:0/433926214 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f008408a6c0 0x7f008408aa90 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f00800097d0 tx=0x7f0080009ae0 comp rx=0 tx=0).stop 2023-03-03T10:48:24.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.429+0000 7f008a128700 1 -- 172.21.15.57:0/433926214 shutdown_connections 2023-03-03T10:48:24.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.429+0000 7f008a128700 1 --2- 172.21.15.57:0/433926214 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f008408a6c0 0x7f008408aa90 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T10:48:24.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.429+0000 7f008a128700 1 -- 172.21.15.57:0/433926214 >> 172.21.15.57:0/433926214 conn(0x7f008406c840 msgr2=0x7f008406ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T10:48:24.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.429+0000 7f008a128700 1 -- 172.21.15.57:0/433926214 shutdown_connections 2023-03-03T10:48:24.436 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.429+0000 7f008a128700 1 -- 172.21.15.57:0/433926214 wait complete. 2023-03-03T10:48:24.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.433+0000 7f008a128700 1 Processor -- start 2023-03-03T10:48:24.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.433+0000 7f008a128700 1 -- start start 2023-03-03T10:48:24.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.433+0000 7f008a128700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f008406a790 0x7f008411b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T10:48:24.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.433+0000 7f008a128700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0084094680 con 0x7f008406a790 2023-03-03T10:48:24.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.433+0000 7f0089126700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f008406a790 0x7f008411b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T10:48:24.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.433+0000 7f0089126700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f008406a790 0x7f008411b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:54824/0 (socket says 172.21.15.57:54824) 2023-03-03T10:48:24.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.433+0000 7f0089126700 1 -- 172.21.15.57:0/439609253 learned_addr learned my addr 172.21.15.57:0/439609253 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T10:48:24.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.437+0000 7f0089126700 1 -- 172.21.15.57:0/439609253 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00800094b0 con 0x7f008406a790 2023-03-03T10:48:24.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.437+0000 7f0089126700 1 --2- 172.21.15.57:0/439609253 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f008406a790 0x7f008411b440 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f0080014040 tx=0x7f0080004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T10:48:24.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.437+0000 7f0079ffb700 1 -- 172.21.15.57:0/439609253 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0080006ea0 con 0x7f008406a790 2023-03-03T10:48:24.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.437+0000 7f0079ffb700 1 -- 172.21.15.57:0/439609253 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0080011630 con 0x7f008406a790 2023-03-03T10:48:24.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.437+0000 7f008a128700 1 -- 172.21.15.57:0/439609253 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f008408a110 con 0x7f008406a790 2023-03-03T10:48:24.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.437+0000 7f0079ffb700 1 -- 172.21.15.57:0/439609253 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0080011910 con 0x7f008406a790 2023-03-03T10:48:24.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.437+0000 7f008a128700 1 -- 172.21.15.57:0/439609253 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0084089f80 con 0x7f008406a790 2023-03-03T10:48:24.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.437+0000 7f008a128700 1 -- 172.21.15.57:0/439609253 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0084123fa0 con 0x7f008406a790 2023-03-03T10:48:24.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.441+0000 7f0079ffb700 1 -- 172.21.15.57:0/439609253 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 12) v1 ==== 42285+0+0 (secure 0 0 0) 0x7f008002d070 con 0x7f008406a790 2023-03-03T10:48:24.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.441+0000 7f0079ffb700 1 --2- 172.21.15.57:0/439609253 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f00680348c0 0x7f0068036d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T10:48:24.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.441+0000 7f0079ffb700 1 -- 172.21.15.57:0/439609253 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3014+0+0 (secure 0 0 0) 0x7f0080047190 con 0x7f008406a790 2023-03-03T10:48:24.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.441+0000 7f0088925700 1 --2- 172.21.15.57:0/439609253 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f00680348c0 0x7f0068036d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T10:48:24.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.441+0000 7f0088925700 1 --2- 172.21.15.57:0/439609253 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f00680348c0 0x7f0068036d70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0074000c00 tx=0x7f00740079c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T10:48:24.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.449+0000 7f0079ffb700 1 -- 172.21.15.57:0/439609253 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f0080011e40 con 0x7f008406a790 2023-03-03T10:48:24.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.637+0000 7f008a128700 1 -- 172.21.15.57:0/439609253 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0084073560 con 0x7f008406a790 2023-03-03T10:48:24.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.637+0000 7f0079ffb700 1 -- 172.21.15.57:0/439609253 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v39) v1 ==== 80+0+122 (secure 0 0 0) 0x7f0080016020 con 0x7f008406a790 2023-03-03T10:48:24.642 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:6811/2058274046 2023-03-04T07:47:57.352461+0000 2023-03-03T10:48:24.643 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:6810/2058274046 2023-03-04T07:47:57.352461+0000 2023-03-03T10:48:24.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.641+0000 7f008a128700 1 -- 172.21.15.57:0/439609253 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f00680348c0 msgr2=0x7f0068036d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T10:48:24.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.641+0000 7f008a128700 1 --2- 172.21.15.57:0/439609253 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f00680348c0 0x7f0068036d70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0074000c00 tx=0x7f00740079c0 comp rx=0 tx=0).stop 2023-03-03T10:48:24.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.641+0000 7f008a128700 1 -- 172.21.15.57:0/439609253 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f008406a790 msgr2=0x7f008411b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T10:48:24.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.641+0000 7f008a128700 1 --2- 172.21.15.57:0/439609253 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f008406a790 0x7f008411b440 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f0080014040 tx=0x7f0080004770 comp rx=0 tx=0).stop 2023-03-03T10:48:24.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.641+0000 7f008a128700 1 -- 172.21.15.57:0/439609253 shutdown_connections 2023-03-03T10:48:24.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.641+0000 7f008a128700 1 --2- 172.21.15.57:0/439609253 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f00680348c0 0x7f0068036d70 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T10:48:24.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.641+0000 7f008a128700 1 --2- 172.21.15.57:0/439609253 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f008406a790 0x7f008411b440 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T10:48:24.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.641+0000 7f008a128700 1 -- 172.21.15.57:0/439609253 >> 172.21.15.57:0/439609253 conn(0x7f008406c840 msgr2=0x7f0084120350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T10:48:24.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.641+0000 7f008a128700 1 -- 172.21.15.57:0/439609253 shutdown_connections 2023-03-03T10:48:24.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.641+0000 7f008a128700 1 -- 172.21.15.57:0/439609253 wait complete. 2023-03-03T10:48:24.650 INFO:teuthology.orchestra.run.smithi057.stderr:listed 2 entries 2023-03-03T10:48:24.680 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-03-03T10:48:24.680 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-03T10:48:24.700 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T10:48:24.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.949+0000 7fc3cb228700 1 Processor -- start 2023-03-03T10:48:24.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.949+0000 7fc3cb228700 1 -- start start 2023-03-03T10:48:24.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.949+0000 7fc3cb228700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc3c41256a0 0x7fc3c4126220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T10:48:24.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.949+0000 7fc3cb228700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3c408d6c0 con 0x7fc3c4125e50 2023-03-03T10:48:24.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.953+0000 7fc3cb228700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3c408a690 con 0x7fc3c41256a0 2023-03-03T10:48:24.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.953+0000 7fc3c9a25700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc3c41256a0 0x7fc3c4126220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T10:48:24.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.953+0000 7fc3ca226700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc3c4125e50 0x7fc3c4089f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:41230/0 (socket says 172.21.15.57:41230) 2023-03-03T10:48:24.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.953+0000 7fc3ca226700 1 -- 172.21.15.57:0/2820194413 learned_addr learned my addr 172.21.15.57:0/2820194413 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T10:48:24.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.953+0000 7fc3c9a25700 1 -- 172.21.15.57:0/2820194413 >> v1:172.21.15.57:6789/0 conn(0x7fc3c4125e50 legacy=0x7fc3c4089f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T10:48:24.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.953+0000 7fc3c9224700 1 -- 172.21.15.57:0/2820194413 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2717235813 0 0) 0x7fc3c408d6c0 con 0x7fc3c4125e50 2023-03-03T10:48:24.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.953+0000 7fc3c9a25700 1 -- 172.21.15.57:0/2820194413 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c408a800 con 0x7fc3c41256a0 2023-03-03T10:48:24.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.953+0000 7fc3c9a25700 1 --2- 172.21.15.57:0/2820194413 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3c41256a0 0x7fc3c4126220 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc3b40097d0 tx=0x7fc3b4009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc971c2bf71c0b11 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T10:48:24.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.953+0000 7fc3c9224700 1 -- 172.21.15.57:0/2820194413 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc3b40041c0 con 0x7fc3c41256a0 2023-03-03T10:48:24.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.953+0000 7fc3c9224700 1 -- 172.21.15.57:0/2820194413 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b4004320 con 0x7fc3c41256a0 2023-03-03T10:48:24.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.953+0000 7fc3c9224700 1 -- 172.21.15.57:0/2820194413 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc3b40036c0 con 0x7fc3c41256a0 2023-03-03T10:48:24.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.957+0000 7fc3cb228700 1 -- 172.21.15.57:0/2820194413 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3c41256a0 msgr2=0x7fc3c4126220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T10:48:24.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.957+0000 7fc3cb228700 1 --2- 172.21.15.57:0/2820194413 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3c41256a0 0x7fc3c4126220 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc3b40097d0 tx=0x7fc3b4009ae0 comp rx=0 tx=0).stop 2023-03-03T10:48:24.962 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.957+0000 7fc3cb228700 1 -- 172.21.15.57:0/2820194413 shutdown_connections 2023-03-03T10:48:24.962 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.957+0000 7fc3cb228700 1 --2- 172.21.15.57:0/2820194413 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3c41256a0 0x7fc3c4126220 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T10:48:24.962 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.957+0000 7fc3cb228700 1 -- 172.21.15.57:0/2820194413 >> 172.21.15.57:0/2820194413 conn(0x7fc3c406c840 msgr2=0x7fc3c406ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T10:48:24.962 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.957+0000 7fc3cb228700 1 -- 172.21.15.57:0/2820194413 shutdown_connections 2023-03-03T10:48:24.962 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.957+0000 7fc3cb228700 1 -- 172.21.15.57:0/2820194413 wait complete. 2023-03-03T10:48:24.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.961+0000 7fc3cb228700 1 Processor -- start 2023-03-03T10:48:24.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.961+0000 7fc3cb228700 1 -- start start 2023-03-03T10:48:24.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.961+0000 7fc3cb228700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3c41256a0 0x7fc3c41bbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T10:48:24.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.961+0000 7fc3cb228700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c41bba60 con 0x7fc3c41256a0 2023-03-03T10:48:24.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.961+0000 7fc3ca226700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3c41256a0 0x7fc3c41bbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T10:48:24.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.961+0000 7fc3ca226700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3c41256a0 0x7fc3c41bbdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:54854/0 (socket says 172.21.15.57:54854) 2023-03-03T10:48:24.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.961+0000 7fc3ca226700 1 -- 172.21.15.57:0/1237566827 learned_addr learned my addr 172.21.15.57:0/1237566827 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T10:48:24.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.961+0000 7fc3ca226700 1 -- 172.21.15.57:0/1237566827 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b40094b0 con 0x7fc3c41256a0 2023-03-03T10:48:24.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.965+0000 7fc3ca226700 1 --2- 172.21.15.57:0/1237566827 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3c41256a0 0x7fc3c41bbdd0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc3c00011e0 tx=0x7fc3c000ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T10:48:24.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.965+0000 7fc3baffd700 1 -- 172.21.15.57:0/1237566827 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc3c0005cc0 con 0x7fc3c41256a0 2023-03-03T10:48:24.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.965+0000 7fc3baffd700 1 -- 172.21.15.57:0/1237566827 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c0005e20 con 0x7fc3c41256a0 2023-03-03T10:48:24.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.965+0000 7fc3baffd700 1 -- 172.21.15.57:0/1237566827 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc3c0007240 con 0x7fc3c41256a0 2023-03-03T10:48:24.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.965+0000 7fc3cb228700 1 -- 172.21.15.57:0/1237566827 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3c408acb0 con 0x7fc3c41256a0 2023-03-03T10:48:24.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.965+0000 7fc3cb228700 1 -- 172.21.15.57:0/1237566827 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3c408ab20 con 0x7fc3c41256a0 2023-03-03T10:48:24.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.965+0000 7fc3cb228700 1 -- 172.21.15.57:0/1237566827 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3c412ba30 con 0x7fc3c41256a0 2023-03-03T10:48:24.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.965+0000 7fc3baffd700 1 -- 172.21.15.57:0/1237566827 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 12) v1 ==== 42285+0+0 (secure 0 0 0) 0x7fc3c0019030 con 0x7fc3c41256a0 2023-03-03T10:48:24.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.969+0000 7fc3baffd700 1 --2- 172.21.15.57:0/1237566827 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fc3a8034920 0x7fc3a8036dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T10:48:24.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.969+0000 7fc3baffd700 1 -- 172.21.15.57:0/1237566827 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3014+0+0 (secure 0 0 0) 0x7fc3c00455d0 con 0x7fc3c41256a0 2023-03-03T10:48:24.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.969+0000 7fc3c9a25700 1 --2- 172.21.15.57:0/1237566827 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fc3a8034920 0x7fc3a8036dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T10:48:24.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.969+0000 7fc3c9a25700 1 --2- 172.21.15.57:0/1237566827 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fc3a8034920 0x7fc3a8036dd0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4014040 tx=0x7fc3b4010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T10:48:24.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:24.973+0000 7fc3baffd700 1 -- 172.21.15.57:0/1237566827 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc3c00198b0 con 0x7fc3c41256a0 2023-03-03T10:48:25.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.153+0000 7fc3cb228700 1 -- 172.21.15.57:0/1237566827 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc3c40619b0 con 0x7fc3c41256a0 2023-03-03T10:48:25.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.153+0000 7fc3baffd700 1 -- 172.21.15.57:0/1237566827 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+9717 (secure 0 0 0) 0x7fc3c0017030 con 0x7fc3c41256a0 2023-03-03T10:48:25.159 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-03-03T10:48:25.159 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":39,"fsid":"5022d617-ad40-4ad9-8d5b-120958296d9c","created":"2023-03-03T07:43:13.256676+0000","modified":"2023-03-03T07:48:00.362886+0000","last_up_change":"2023-03-03T07:43:22.721740+0000","last_in_change":"2023-03-03T07:43:13.786190+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.60000002384185791,"backfillfull_ratio":0.55000001192092896,"nearfull_ratio":0.5,"cluster_snapshot":"","pool_max":4,"max_osd":1,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-03T07:43:22.864508+0000","flags":2049,"flags_names":"hashpspool,nearfull","type":1,"size":1,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":1,"score_stable":1,"optimal_score":1,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-03T07:43:28.091327+0000","flags":2049,"flags_names":"hashpspool,nearfull","type":1,"size":1,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1,"score_stable":1,"optimal_score":1,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-03T07:43:33.981804+0000","flags":2049,"flags_names":"hashpspool,nearfull","type":1,"size":1,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1,"score_stable":1,"optimal_score":1,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-03T07:43:35.408700+0000","flags":2049,"flags_names":"hashpspool,nearfull","type":1,"size":1,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1,"score_stable":1,"optimal_score":1,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d83f7ba7-9d9d-4309-95b9-2b8ad96f2f8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":6,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":28687},{"type":"v1","addr":"172.21.15.57:6801","nonce":28687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":28687},{"type":"v1","addr":"172.21.15.57:6803","nonce":28687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":28687},{"type":"v1","addr":"172.21.15.57:6807","nonce":28687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":28687},{"type":"v1","addr":"172.21.15.57:6805","nonce":28687}]},"public_addr":"172.21.15.57:6801/28687","cluster_addr":"172.21.15.57:6803/28687","heartbeat_back_addr":"172.21.15.57:6807/28687","heartbeat_front_addr":"172.21.15.57:6805/28687","state":["exists","nearfull","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T07:43:19.859898+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:6811/2058274046":"2023-03-04T07:47:57.352461+0000","172.21.15.57:6810/2058274046":"2023-03-04T07:47:57.352461+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T10:48:25.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.161+0000 7fc3cb228700 1 -- 172.21.15.57:0/1237566827 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fc3a8034920 msgr2=0x7fc3a8036dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T10:48:25.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.161+0000 7fc3cb228700 1 --2- 172.21.15.57:0/1237566827 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fc3a8034920 0x7fc3a8036dd0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4014040 tx=0x7fc3b4010000 comp rx=0 tx=0).stop 2023-03-03T10:48:25.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.161+0000 7fc3cb228700 1 -- 172.21.15.57:0/1237566827 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3c41256a0 msgr2=0x7fc3c41bbdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T10:48:25.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.161+0000 7fc3cb228700 1 --2- 172.21.15.57:0/1237566827 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3c41256a0 0x7fc3c41bbdd0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc3c00011e0 tx=0x7fc3c000ca60 comp rx=0 tx=0).stop 2023-03-03T10:48:25.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.161+0000 7fc3cb228700 1 -- 172.21.15.57:0/1237566827 shutdown_connections 2023-03-03T10:48:25.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.161+0000 7fc3cb228700 1 --2- 172.21.15.57:0/1237566827 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fc3a8034920 0x7fc3a8036dd0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T10:48:25.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.161+0000 7fc3cb228700 1 --2- 172.21.15.57:0/1237566827 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3c41256a0 0x7fc3c41bbdd0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T10:48:25.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.161+0000 7fc3cb228700 1 -- 172.21.15.57:0/1237566827 >> 172.21.15.57:0/1237566827 conn(0x7fc3c406c840 msgr2=0x7fc3c4122280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T10:48:25.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.161+0000 7fc3cb228700 1 -- 172.21.15.57:0/1237566827 shutdown_connections 2023-03-03T10:48:25.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.161+0000 7fc3cb228700 1 -- 172.21.15.57:0/1237566827 wait complete. 2023-03-03T10:48:25.196 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-03T07:43:22.864508+0000', 'flags': 2049, 'flags_names': 'hashpspool,nearfull', 'type': 1, 'size': 1, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 1, 'score_stable': 1, 'optimal_score': 1, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-03-03T07:43:28.091327+0000', 'flags': 2049, 'flags_names': 'hashpspool,nearfull', 'type': 1, 'size': 1, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1, 'score_stable': 1, 'optimal_score': 1, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-03T07:43:33.981804+0000', 'flags': 2049, 'flags_names': 'hashpspool,nearfull', 'type': 1, 'size': 1, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1, 'score_stable': 1, 'optimal_score': 1, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-03-03T07:43:35.408700+0000', 'flags': 2049, 'flags_names': 'hashpspool,nearfull', 'type': 1, 'size': 1, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1, 'score_stable': 1, 'optimal_score': 1, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-03T10:48:25.197 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-03T10:48:25.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.397+0000 7f9e518a7700 1 Processor -- start 2023-03-03T10:48:25.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.397+0000 7f9e518a7700 1 -- start start 2023-03-03T10:48:25.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.401+0000 7f9e518a7700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9e4c0930a0 0x7f9e4c08b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T10:48:25.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.401+0000 7f9e518a7700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e4c08c220 con 0x7f9e4c092cd0 2023-03-03T10:48:25.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.401+0000 7f9e518a7700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e4c08c530 con 0x7f9e4c0930a0 2023-03-03T10:48:25.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.401+0000 7f9e4a7fc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9e4c0930a0 0x7f9e4c08b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T10:48:25.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.401+0000 7f9e4affd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f9e4c092cd0 0x7f9e4c08b090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:41236/0 (socket says 172.21.15.57:41236) 2023-03-03T10:48:25.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.401+0000 7f9e4affd700 1 -- 172.21.15.57:0/2576095034 learned_addr learned my addr 172.21.15.57:0/2576095034 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T10:48:25.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.401+0000 7f9e4a7fc700 1 -- 172.21.15.57:0/2576095034 >> v1:172.21.15.57:6789/0 conn(0x7f9e4c092cd0 legacy=0x7f9e4c08b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T10:48:25.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.401+0000 7f9e4a7fc700 1 -- 172.21.15.57:0/2576095034 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e4c093520 con 0x7f9e4c0930a0 2023-03-03T10:48:25.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.401+0000 7f9e4a7fc700 1 --2- 172.21.15.57:0/2576095034 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e4c0930a0 0x7f9e4c08b7a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9e400099e0 tx=0x7f9e40009cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4ddac65174e3a7f server_cookie=0 in_seq=0 out_seq=0 2023-03-03T10:48:25.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.401+0000 7f9e49ffb700 1 -- 172.21.15.57:0/2576095034 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9e40004160 con 0x7f9e4c0930a0 2023-03-03T10:48:25.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.405+0000 7f9e49ffb700 1 -- 172.21.15.57:0/2576095034 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e400042c0 con 0x7f9e4c0930a0 2023-03-03T10:48:25.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.405+0000 7f9e49ffb700 1 -- 172.21.15.57:0/2576095034 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9e40004580 con 0x7f9e4c0930a0 2023-03-03T10:48:25.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.405+0000 7f9e518a7700 1 -- 172.21.15.57:0/2576095034 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e4c0930a0 msgr2=0x7f9e4c08b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T10:48:25.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.405+0000 7f9e518a7700 1 --2- 172.21.15.57:0/2576095034 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e4c0930a0 0x7f9e4c08b7a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9e400099e0 tx=0x7f9e40009cf0 comp rx=0 tx=0).stop 2023-03-03T10:48:25.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.405+0000 7f9e518a7700 1 -- 172.21.15.57:0/2576095034 shutdown_connections 2023-03-03T10:48:25.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.405+0000 7f9e518a7700 1 --2- 172.21.15.57:0/2576095034 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e4c0930a0 0x7f9e4c08b7a0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T10:48:25.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.405+0000 7f9e518a7700 1 -- 172.21.15.57:0/2576095034 >> 172.21.15.57:0/2576095034 conn(0x7f9e4c069f00 msgr2=0x7f9e4c06a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T10:48:25.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.405+0000 7f9e518a7700 1 -- 172.21.15.57:0/2576095034 shutdown_connections 2023-03-03T10:48:25.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.405+0000 7f9e518a7700 1 -- 172.21.15.57:0/2576095034 wait complete. 2023-03-03T10:48:25.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.409+0000 7f9e518a7700 1 Processor -- start 2023-03-03T10:48:25.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.409+0000 7f9e518a7700 1 -- start start 2023-03-03T10:48:25.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.409+0000 7f9e518a7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e4c092cd0 0x7f9e4c11a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T10:48:25.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.409+0000 7f9e518a7700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4c11bc70 con 0x7f9e4c092cd0 2023-03-03T10:48:25.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.409+0000 7f9e4affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e4c092cd0 0x7f9e4c11a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T10:48:25.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.409+0000 7f9e4affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e4c092cd0 0x7f9e4c11a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:54872/0 (socket says 172.21.15.57:54872) 2023-03-03T10:48:25.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.409+0000 7f9e4affd700 1 -- 172.21.15.57:0/3992035814 learned_addr learned my addr 172.21.15.57:0/3992035814 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T10:48:25.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.409+0000 7f9e4affd700 1 -- 172.21.15.57:0/3992035814 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e400094b0 con 0x7f9e4c092cd0 2023-03-03T10:48:25.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.409+0000 7f9e4affd700 1 --2- 172.21.15.57:0/3992035814 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e4c092cd0 0x7f9e4c11a4f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c00c480 tx=0x7f9e3c00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T10:48:25.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.413+0000 7f9e33fff700 1 -- 172.21.15.57:0/3992035814 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9e3c005cc0 con 0x7f9e4c092cd0 2023-03-03T10:48:25.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.413+0000 7f9e33fff700 1 -- 172.21.15.57:0/3992035814 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e3c005e20 con 0x7f9e4c092cd0 2023-03-03T10:48:25.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.413+0000 7f9e33fff700 1 -- 172.21.15.57:0/3992035814 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9e3c0049c0 con 0x7f9e4c092cd0 2023-03-03T10:48:25.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.413+0000 7f9e518a7700 1 -- 172.21.15.57:0/3992035814 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e4c08bce0 con 0x7f9e4c092cd0 2023-03-03T10:48:25.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.413+0000 7f9e518a7700 1 -- 172.21.15.57:0/3992035814 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e4c06ac00 con 0x7f9e4c092cd0 2023-03-03T10:48:25.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.413+0000 7f9e518a7700 1 -- 172.21.15.57:0/3992035814 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e4c08be70 con 0x7f9e4c092cd0 2023-03-03T10:48:25.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.413+0000 7f9e33fff700 1 -- 172.21.15.57:0/3992035814 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 12) v1 ==== 42285+0+0 (secure 0 0 0) 0x7f9e3c010070 con 0x7f9e4c092cd0 2023-03-03T10:48:25.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.417+0000 7f9e33fff700 1 --2- 172.21.15.57:0/3992035814 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f9e38034880 0x7f9e38036d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T10:48:25.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.417+0000 7f9e33fff700 1 -- 172.21.15.57:0/3992035814 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3014+0+0 (secure 0 0 0) 0x7f9e3c045a40 con 0x7f9e4c092cd0 2023-03-03T10:48:25.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.417+0000 7f9e4a7fc700 1 --2- 172.21.15.57:0/3992035814 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f9e38034880 0x7f9e38036d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T10:48:25.422 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.417+0000 7f9e4a7fc700 1 --2- 172.21.15.57:0/3992035814 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f9e38034880 0x7f9e38036d30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9e40009d30 tx=0x7f9e40008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T10:48:25.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.425+0000 7f9e33fff700 1 -- 172.21.15.57:0/3992035814 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9e3c004c80 con 0x7f9e4c092cd0 2023-03-03T10:48:25.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.601+0000 7f9e518a7700 1 -- 172.21.15.57:0/3992035814 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9e4c04eff0 con 0x7f9e4c092cd0 2023-03-03T10:48:25.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.601+0000 7f9e33fff700 1 -- 172.21.15.57:0/3992035814 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9e3c0113a0 con 0x7f9e4c092cd0 2023-03-03T10:48:25.606 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-03-03T10:48:25.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.605+0000 7f9e518a7700 1 -- 172.21.15.57:0/3992035814 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f9e38034880 msgr2=0x7f9e38036d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T10:48:25.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.605+0000 7f9e518a7700 1 --2- 172.21.15.57:0/3992035814 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f9e38034880 0x7f9e38036d30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9e40009d30 tx=0x7f9e40008030 comp rx=0 tx=0).stop 2023-03-03T10:48:25.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.605+0000 7f9e518a7700 1 -- 172.21.15.57:0/3992035814 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e4c092cd0 msgr2=0x7f9e4c11a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T10:48:25.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.605+0000 7f9e518a7700 1 --2- 172.21.15.57:0/3992035814 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e4c092cd0 0x7f9e4c11a4f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c00c480 tx=0x7f9e3c00c840 comp rx=0 tx=0).stop 2023-03-03T10:48:25.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.605+0000 7f9e518a7700 1 -- 172.21.15.57:0/3992035814 shutdown_connections 2023-03-03T10:48:25.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.605+0000 7f9e518a7700 1 --2- 172.21.15.57:0/3992035814 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f9e38034880 0x7f9e38036d30 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T10:48:25.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.605+0000 7f9e518a7700 1 --2- 172.21.15.57:0/3992035814 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e4c092cd0 0x7f9e4c11a4f0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T10:48:25.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.605+0000 7f9e518a7700 1 -- 172.21.15.57:0/3992035814 >> 172.21.15.57:0/3992035814 conn(0x7f9e4c069f00 msgr2=0x7f9e4c06ee90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T10:48:25.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.605+0000 7f9e518a7700 1 -- 172.21.15.57:0/3992035814 shutdown_connections 2023-03-03T10:48:25.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.605+0000 7f9e518a7700 1 -- 172.21.15.57:0/3992035814 wait complete. 2023-03-03T10:48:25.644 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-03T10:48:25.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.845+0000 7f8cf33e6700 1 Processor -- start 2023-03-03T10:48:25.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.845+0000 7f8cf33e6700 1 -- start start 2023-03-03T10:48:25.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.849+0000 7f8cf33e6700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8cec127720 0x7f8cec129b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T10:48:25.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.849+0000 7f8cf33e6700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cec08d2b0 con 0x7f8cec08bf80 2023-03-03T10:48:25.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.849+0000 7f8cf33e6700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cec08d550 con 0x7f8cec127720 2023-03-03T10:48:25.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.849+0000 7f8cf23e4700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f8cec08bf80 0x7f8cec08c350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:41250/0 (socket says 172.21.15.57:41250) 2023-03-03T10:48:25.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.849+0000 7f8cf23e4700 1 -- 172.21.15.57:0/2239550912 learned_addr learned my addr 172.21.15.57:0/2239550912 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T10:48:25.855 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.849+0000 7f8cf1be3700 1 --2- 172.21.15.57:0/2239550912 >> v2:172.21.15.57:3300/0 conn(0x7f8cec127720 0x7f8cec129b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T10:48:25.855 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.849+0000 7f8cf13e2700 1 -- 172.21.15.57:0/2239550912 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1701586968 0 0) 0x7f8cec08d2b0 con 0x7f8cec08bf80 2023-03-03T10:48:25.855 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.849+0000 7f8cf13e2700 1 -- 172.21.15.57:0/2239550912 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cd80035d0 con 0x7f8cec08bf80 2023-03-03T10:48:25.856 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.849+0000 7f8cf1be3700 1 -- 172.21.15.57:0/2239550912 >> v1:172.21.15.57:6789/0 conn(0x7f8cec08bf80 legacy=0x7f8cec08c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T10:48:25.856 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.849+0000 7f8cf1be3700 1 -- 172.21.15.57:0/2239550912 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cec08a500 con 0x7f8cec127720 2023-03-03T10:48:25.856 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.849+0000 7f8cf1be3700 1 --2- 172.21.15.57:0/2239550912 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8cec127720 0x7f8cec129b00 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc0097d0 tx=0x7f8cdc009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dea45b06761c672 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T10:48:25.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.849+0000 7f8cf13e2700 1 -- 172.21.15.57:0/2239550912 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8cdc004160 con 0x7f8cec127720 2023-03-03T10:48:25.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.853+0000 7f8cf13e2700 1 -- 172.21.15.57:0/2239550912 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cdc0042c0 con 0x7f8cec127720 2023-03-03T10:48:25.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.853+0000 7f8cf13e2700 1 -- 172.21.15.57:0/2239550912 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8cdc0045a0 con 0x7f8cec127720 2023-03-03T10:48:25.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.853+0000 7f8cf33e6700 1 -- 172.21.15.57:0/2239550912 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8cec127720 msgr2=0x7f8cec129b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T10:48:25.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.853+0000 7f8cf33e6700 1 --2- 172.21.15.57:0/2239550912 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8cec127720 0x7f8cec129b00 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc0097d0 tx=0x7f8cdc009ae0 comp rx=0 tx=0).stop 2023-03-03T10:48:25.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.853+0000 7f8cf33e6700 1 -- 172.21.15.57:0/2239550912 shutdown_connections 2023-03-03T10:48:25.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.853+0000 7f8cf33e6700 1 --2- 172.21.15.57:0/2239550912 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8cec127720 0x7f8cec129b00 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T10:48:25.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.853+0000 7f8cf33e6700 1 -- 172.21.15.57:0/2239550912 >> 172.21.15.57:0/2239550912 conn(0x7f8cec06da50 msgr2=0x7f8cec06fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T10:48:25.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.853+0000 7f8cf33e6700 1 -- 172.21.15.57:0/2239550912 shutdown_connections 2023-03-03T10:48:25.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.853+0000 7f8cf33e6700 1 -- 172.21.15.57:0/2239550912 wait complete. 2023-03-03T10:48:25.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.857+0000 7f8cf33e6700 1 Processor -- start 2023-03-03T10:48:25.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.857+0000 7f8cf33e6700 1 -- start start 2023-03-03T10:48:25.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.857+0000 7f8cf33e6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8cec08bf80 0x7f8cec1bbd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T10:48:25.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.857+0000 7f8cf33e6700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cec091200 con 0x7f8cec08bf80 2023-03-03T10:48:25.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.857+0000 7f8cf23e4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8cec08bf80 0x7f8cec1bbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T10:48:25.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.857+0000 7f8cf23e4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8cec08bf80 0x7f8cec1bbd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:54892/0 (socket says 172.21.15.57:54892) 2023-03-03T10:48:25.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.857+0000 7f8cf23e4700 1 -- 172.21.15.57:0/1981547302 learned_addr learned my addr 172.21.15.57:0/1981547302 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T10:48:25.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.857+0000 7f8cf23e4700 1 -- 172.21.15.57:0/1981547302 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cdc0094b0 con 0x7f8cec08bf80 2023-03-03T10:48:25.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.861+0000 7f8cf23e4700 1 --2- 172.21.15.57:0/1981547302 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8cec08bf80 0x7f8cec1bbd10 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8ce8001260 tx=0x7f8ce800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T10:48:25.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.861+0000 7f8ce2ffd700 1 -- 172.21.15.57:0/1981547302 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ce8007410 con 0x7f8cec08bf80 2023-03-03T10:48:25.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.861+0000 7f8ce2ffd700 1 -- 172.21.15.57:0/1981547302 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ce8007570 con 0x7f8cec08bf80 2023-03-03T10:48:25.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.861+0000 7f8ce2ffd700 1 -- 172.21.15.57:0/1981547302 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ce8005850 con 0x7f8cec08bf80 2023-03-03T10:48:25.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.861+0000 7f8cf33e6700 1 -- 172.21.15.57:0/1981547302 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cec08ac00 con 0x7f8cec08bf80 2023-03-03T10:48:25.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.861+0000 7f8cf33e6700 1 -- 172.21.15.57:0/1981547302 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cec08caa0 con 0x7f8cec08bf80 2023-03-03T10:48:25.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.861+0000 7f8cf33e6700 1 -- 172.21.15.57:0/1981547302 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cec08ad90 con 0x7f8cec08bf80 2023-03-03T10:48:25.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.865+0000 7f8ce2ffd700 1 -- 172.21.15.57:0/1981547302 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 12) v1 ==== 42285+0+0 (secure 0 0 0) 0x7f8ce8019030 con 0x7f8cec08bf80 2023-03-03T10:48:25.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.865+0000 7f8ce2ffd700 1 --2- 172.21.15.57:0/1981547302 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f8cd00348d0 0x7f8cd0036d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T10:48:25.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.865+0000 7f8ce2ffd700 1 -- 172.21.15.57:0/1981547302 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3014+0+0 (secure 0 0 0) 0x7f8ce8045600 con 0x7f8cec08bf80 2023-03-03T10:48:25.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.865+0000 7f8cf1be3700 1 --2- 172.21.15.57:0/1981547302 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f8cd00348d0 0x7f8cd0036d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T10:48:25.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.865+0000 7f8cf1be3700 1 --2- 172.21.15.57:0/1981547302 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f8cd00348d0 0x7f8cd0036d80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc006ee0 tx=0x7f8cdc008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T10:48:25.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:25.873+0000 7f8ce2ffd700 1 -- 172.21.15.57:0/1981547302 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8ce80198b0 con 0x7f8cec08bf80 2023-03-03T10:48:26.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.049+0000 7f8cf33e6700 1 -- 172.21.15.57:0/1981547302 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8cec122950 con 0x7f8cec08bf80 2023-03-03T10:48:26.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.049+0000 7f8ce2ffd700 1 -- 172.21.15.57:0/1981547302 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v39) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8ce8017030 con 0x7f8cec08bf80 2023-03-03T10:48:26.054 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2023-03-03T10:48:26.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.053+0000 7f8cf33e6700 1 -- 172.21.15.57:0/1981547302 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f8cd00348d0 msgr2=0x7f8cd0036d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T10:48:26.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.053+0000 7f8cf33e6700 1 --2- 172.21.15.57:0/1981547302 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f8cd00348d0 0x7f8cd0036d80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc006ee0 tx=0x7f8cdc008030 comp rx=0 tx=0).stop 2023-03-03T10:48:26.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.053+0000 7f8cf33e6700 1 -- 172.21.15.57:0/1981547302 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8cec08bf80 msgr2=0x7f8cec1bbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T10:48:26.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.053+0000 7f8cf33e6700 1 --2- 172.21.15.57:0/1981547302 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8cec08bf80 0x7f8cec1bbd10 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8ce8001260 tx=0x7f8ce800ca10 comp rx=0 tx=0).stop 2023-03-03T10:48:26.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.053+0000 7f8cf33e6700 1 -- 172.21.15.57:0/1981547302 shutdown_connections 2023-03-03T10:48:26.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.053+0000 7f8cf33e6700 1 --2- 172.21.15.57:0/1981547302 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f8cd00348d0 0x7f8cd0036d80 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T10:48:26.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.053+0000 7f8cf33e6700 1 --2- 172.21.15.57:0/1981547302 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8cec08bf80 0x7f8cec1bbd10 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T10:48:26.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.053+0000 7f8cf33e6700 1 -- 172.21.15.57:0/1981547302 >> 172.21.15.57:0/1981547302 conn(0x7f8cec06da50 msgr2=0x7f8cec11f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T10:48:26.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.053+0000 7f8cf33e6700 1 -- 172.21.15.57:0/1981547302 shutdown_connections 2023-03-03T10:48:26.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.053+0000 7f8cf33e6700 1 -- 172.21.15.57:0/1981547302 wait complete. 2023-03-03T10:48:26.091 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-03T10:48:26.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.305+0000 7fe20359e700 1 Processor -- start 2023-03-03T10:48:26.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.305+0000 7fe20359e700 1 -- start start 2023-03-03T10:48:26.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.305+0000 7fe20359e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe20412ee40 0x7fe204131220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T10:48:26.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.305+0000 7fe20359e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe20408c3e0 con 0x7fe204095d70 2023-03-03T10:48:26.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.305+0000 7fe20359e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe20408c1f0 con 0x7fe20412ee40 2023-03-03T10:48:26.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.305+0000 7fe20259c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fe204095d70 0x7fe204096140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:41266/0 (socket says 172.21.15.57:41266) 2023-03-03T10:48:26.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.305+0000 7fe20259c700 1 -- 172.21.15.57:0/1580662441 learned_addr learned my addr 172.21.15.57:0/1580662441 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T10:48:26.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.305+0000 7fe1fbfff700 1 --2- 172.21.15.57:0/1580662441 >> v2:172.21.15.57:3300/0 conn(0x7fe20412ee40 0x7fe204131220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T10:48:26.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.305+0000 7fe201d9b700 1 -- 172.21.15.57:0/1580662441 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1878899562 0 0) 0x7fe20408c3e0 con 0x7fe204095d70 2023-03-03T10:48:26.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.305+0000 7fe201d9b700 1 -- 172.21.15.57:0/1580662441 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1f00035d0 con 0x7fe204095d70 2023-03-03T10:48:26.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.305+0000 7fe201d9b700 1 -- 172.21.15.57:0/1580662441 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3882335864 0 0) 0x7fe1f00035d0 con 0x7fe204095d70 2023-03-03T10:48:26.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.305+0000 7fe201d9b700 1 -- 172.21.15.57:0/1580662441 >> v2:172.21.15.57:3300/0 conn(0x7fe20412ee40 msgr2=0x7fe204131220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T10:48:26.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.305+0000 7fe201d9b700 1 --2- 172.21.15.57:0/1580662441 >> v2:172.21.15.57:3300/0 conn(0x7fe20412ee40 0x7fe204131220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T10:48:26.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.305+0000 7fe201d9b700 1 -- 172.21.15.57:0/1580662441 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe20408b510 con 0x7fe204095d70 2023-03-03T10:48:26.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.305+0000 7fe201d9b700 1 -- 172.21.15.57:0/1580662441 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (unknown 2779775165 0 0) 0x7fe1f4005070 con 0x7fe204095d70 2023-03-03T10:48:26.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.305+0000 7fe201d9b700 1 -- 172.21.15.57:0/1580662441 >> v1:172.21.15.57:6789/0 conn(0x7fe204095d70 legacy=0x7fe204096140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T10:48:26.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.305+0000 7fe201d9b700 1 --2- 172.21.15.57:0/1580662441 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1f0003b10 0x7fe1f0003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T10:48:26.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.305+0000 7fe201d9b700 1 -- 172.21.15.57:0/1580662441 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f00045c0 con 0x7fe1f0003b10 2023-03-03T10:48:26.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.309+0000 7fe20259c700 1 --2- 172.21.15.57:0/1580662441 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1f0003b10 0x7fe1f0003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T10:48:26.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.309+0000 7fe20259c700 1 -- 172.21.15.57:0/1580662441 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f00035d0 con 0x7fe1f0003b10 2023-03-03T10:48:26.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.309+0000 7fe20259c700 1 --2- 172.21.15.57:0/1580662441 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1f0003b10 0x7fe1f0003f00 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fe1f4007f70 tx=0x7fe1f00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f4afad68a08f950 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T10:48:26.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.309+0000 7fe201d9b700 1 -- 172.21.15.57:0/1580662441 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1f4005980 con 0x7fe1f0003b10 2023-03-03T10:48:26.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.309+0000 7fe201d9b700 1 -- 172.21.15.57:0/1580662441 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f4005ae0 con 0x7fe1f0003b10 2023-03-03T10:48:26.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.309+0000 7fe201d9b700 1 -- 172.21.15.57:0/1580662441 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1f4005da0 con 0x7fe1f0003b10 2023-03-03T10:48:26.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.309+0000 7fe20359e700 1 -- 172.21.15.57:0/1580662441 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1f0003b10 msgr2=0x7fe1f0003f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T10:48:26.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.309+0000 7fe20359e700 1 --2- 172.21.15.57:0/1580662441 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1f0003b10 0x7fe1f0003f00 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fe1f4007f70 tx=0x7fe1f00058a0 comp rx=0 tx=0).stop 2023-03-03T10:48:26.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.309+0000 7fe20359e700 1 -- 172.21.15.57:0/1580662441 shutdown_connections 2023-03-03T10:48:26.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.309+0000 7fe20359e700 1 --2- 172.21.15.57:0/1580662441 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1f0003b10 0x7fe1f0003f00 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T10:48:26.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.309+0000 7fe20359e700 1 --2- 172.21.15.57:0/1580662441 >> v2:172.21.15.57:3300/0 conn(0x7fe20412ee40 0x7fe204131220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T10:48:26.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.309+0000 7fe20359e700 1 -- 172.21.15.57:0/1580662441 >> 172.21.15.57:0/1580662441 conn(0x7fe20406da50 msgr2=0x7fe20406fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T10:48:26.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.313+0000 7fe20359e700 1 -- 172.21.15.57:0/1580662441 shutdown_connections 2023-03-03T10:48:26.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.313+0000 7fe20359e700 1 -- 172.21.15.57:0/1580662441 wait complete. 2023-03-03T10:48:26.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.313+0000 7fe20359e700 1 Processor -- start 2023-03-03T10:48:26.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.313+0000 7fe20359e700 1 -- start start 2023-03-03T10:48:26.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.317+0000 7fe20359e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1f0003b10 0x7fe204125510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T10:48:26.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.317+0000 7fe20359e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe204126de0 con 0x7fe1f0003b10 2023-03-03T10:48:26.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.317+0000 7fe20259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1f0003b10 0x7fe204125510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T10:48:26.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.317+0000 7fe20259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1f0003b10 0x7fe204125510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:54912/0 (socket says 172.21.15.57:54912) 2023-03-03T10:48:26.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.317+0000 7fe20259c700 1 -- 172.21.15.57:0/553594190 learned_addr learned my addr 172.21.15.57:0/553594190 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T10:48:26.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.317+0000 7fe20259c700 1 -- 172.21.15.57:0/553594190 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2041318f0 con 0x7fe1f0003b10 2023-03-03T10:48:26.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.317+0000 7fe20259c700 1 --2- 172.21.15.57:0/553594190 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1f0003b10 0x7fe204125510 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fe1f4005930 tx=0x7fe1f4005330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T10:48:26.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.317+0000 7fe1faffd700 1 -- 172.21.15.57:0/553594190 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1f4007a90 con 0x7fe1f0003b10 2023-03-03T10:48:26.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.317+0000 7fe1faffd700 1 -- 172.21.15.57:0/553594190 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f4005960 con 0x7fe1f0003b10 2023-03-03T10:48:26.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.317+0000 7fe1faffd700 1 -- 172.21.15.57:0/553594190 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1f4007200 con 0x7fe1f0003b10 2023-03-03T10:48:26.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.317+0000 7fe20359e700 1 -- 172.21.15.57:0/553594190 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe204131760 con 0x7fe1f0003b10 2023-03-03T10:48:26.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.317+0000 7fe20359e700 1 -- 172.21.15.57:0/553594190 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe204131a80 con 0x7fe1f0003b10 2023-03-03T10:48:26.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.321+0000 7fe20359e700 1 -- 172.21.15.57:0/553594190 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2040619b0 con 0x7fe1f0003b10 2023-03-03T10:48:26.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.321+0000 7fe1faffd700 1 -- 172.21.15.57:0/553594190 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 12) v1 ==== 42285+0+0 (secure 0 0 0) 0x7fe1f402d070 con 0x7fe1f0003b10 2023-03-03T10:48:26.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.321+0000 7fe1faffd700 1 --2- 172.21.15.57:0/553594190 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fe1e40348d0 0x7fe1e4036d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T10:48:26.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.321+0000 7fe1faffd700 1 -- 172.21.15.57:0/553594190 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3014+0+0 (secure 0 0 0) 0x7fe1f40473c0 con 0x7fe1f0003b10 2023-03-03T10:48:26.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.321+0000 7fe1fbfff700 1 --2- 172.21.15.57:0/553594190 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fe1e40348d0 0x7fe1e4036d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T10:48:26.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.325+0000 7fe1fbfff700 1 --2- 172.21.15.57:0/553594190 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fe1e40348d0 0x7fe1e4036d80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec0099c0 tx=0x7fe1ec009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T10:48:26.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.329+0000 7fe1faffd700 1 -- 172.21.15.57:0/553594190 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe1f4024360 con 0x7fe1f0003b10 2023-03-03T10:48:26.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.509+0000 7fe20359e700 1 -- 172.21.15.57:0/553594190 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe204073410 con 0x7fe1f0003b10 2023-03-03T10:48:26.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.509+0000 7fe1faffd700 1 -- 172.21.15.57:0/553594190 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v39) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe1f4017070 con 0x7fe1f0003b10 2023-03-03T10:48:26.514 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2023-03-03T10:48:26.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.513+0000 7fe20359e700 1 -- 172.21.15.57:0/553594190 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fe1e40348d0 msgr2=0x7fe1e4036d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T10:48:26.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.513+0000 7fe20359e700 1 --2- 172.21.15.57:0/553594190 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fe1e40348d0 0x7fe1e4036d80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec0099c0 tx=0x7fe1ec009240 comp rx=0 tx=0).stop 2023-03-03T10:48:26.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.513+0000 7fe20359e700 1 -- 172.21.15.57:0/553594190 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1f0003b10 msgr2=0x7fe204125510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T10:48:26.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.513+0000 7fe20359e700 1 --2- 172.21.15.57:0/553594190 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1f0003b10 0x7fe204125510 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fe1f4005930 tx=0x7fe1f4005330 comp rx=0 tx=0).stop 2023-03-03T10:48:26.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.513+0000 7fe20359e700 1 -- 172.21.15.57:0/553594190 shutdown_connections 2023-03-03T10:48:26.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.513+0000 7fe20359e700 1 --2- 172.21.15.57:0/553594190 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fe1e40348d0 0x7fe1e4036d80 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T10:48:26.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.513+0000 7fe20359e700 1 --2- 172.21.15.57:0/553594190 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1f0003b10 0x7fe204125510 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T10:48:26.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.513+0000 7fe20359e700 1 -- 172.21.15.57:0/553594190 >> 172.21.15.57:0/553594190 conn(0x7fe20406da50 msgr2=0x7fe20406ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T10:48:26.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.513+0000 7fe20359e700 1 -- 172.21.15.57:0/553594190 shutdown_connections 2023-03-03T10:48:26.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.513+0000 7fe20359e700 1 -- 172.21.15.57:0/553594190 wait complete. 2023-03-03T10:48:26.550 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-03T10:48:26.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.753+0000 7f62814c8700 1 Processor -- start 2023-03-03T10:48:26.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.753+0000 7f62814c8700 1 -- start start 2023-03-03T10:48:26.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.753+0000 7f62814c8700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f627c094700 0x7f627c08a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T10:48:26.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.753+0000 7f62814c8700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f627c08b520 con 0x7f627c121cd0 2023-03-03T10:48:26.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.753+0000 7f62814c8700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f627c121530 con 0x7f627c094700 2023-03-03T10:48:26.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.757+0000 7f627affd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f627c121cd0 0x7f627c089f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:41278/0 (socket says 172.21.15.57:41278) 2023-03-03T10:48:26.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.757+0000 7f627affd700 1 -- 172.21.15.57:0/3476058025 learned_addr learned my addr 172.21.15.57:0/3476058025 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T10:48:26.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.757+0000 7f627a7fc700 1 --2- 172.21.15.57:0/3476058025 >> v2:172.21.15.57:3300/0 conn(0x7f627c094700 0x7f627c08a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T10:48:26.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.757+0000 7f6279ffb700 1 -- 172.21.15.57:0/3476058025 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 573324980 0 0) 0x7f627c08b520 con 0x7f627c121cd0 2023-03-03T10:48:26.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.757+0000 7f6279ffb700 1 -- 172.21.15.57:0/3476058025 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62640035d0 con 0x7f627c121cd0 2023-03-03T10:48:26.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.757+0000 7f627a7fc700 1 -- 172.21.15.57:0/3476058025 >> v1:172.21.15.57:6789/0 conn(0x7f627c121cd0 legacy=0x7f627c089f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T10:48:26.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.757+0000 7f627a7fc700 1 -- 172.21.15.57:0/3476058025 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f627c1216a0 con 0x7f627c094700 2023-03-03T10:48:26.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.757+0000 7f627a7fc700 1 --2- 172.21.15.57:0/3476058025 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f627c094700 0x7f627c08a690 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f62700099e0 tx=0x7f6270009cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2dc7da6880b4a49 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T10:48:26.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.757+0000 7f6279ffb700 1 -- 172.21.15.57:0/3476058025 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6270004030 con 0x7f627c094700 2023-03-03T10:48:26.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.757+0000 7f6279ffb700 1 -- 172.21.15.57:0/3476058025 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6270004190 con 0x7f627c094700 2023-03-03T10:48:26.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.757+0000 7f6279ffb700 1 -- 172.21.15.57:0/3476058025 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6270004450 con 0x7f627c094700 2023-03-03T10:48:26.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.757+0000 7f62814c8700 1 -- 172.21.15.57:0/3476058025 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f627c094700 msgr2=0x7f627c08a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T10:48:26.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.757+0000 7f62814c8700 1 --2- 172.21.15.57:0/3476058025 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f627c094700 0x7f627c08a690 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f62700099e0 tx=0x7f6270009cf0 comp rx=0 tx=0).stop 2023-03-03T10:48:26.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.757+0000 7f62814c8700 1 -- 172.21.15.57:0/3476058025 shutdown_connections 2023-03-03T10:48:26.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.757+0000 7f62814c8700 1 --2- 172.21.15.57:0/3476058025 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f627c094700 0x7f627c08a690 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T10:48:26.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.757+0000 7f62814c8700 1 -- 172.21.15.57:0/3476058025 >> 172.21.15.57:0/3476058025 conn(0x7f627c069f00 msgr2=0x7f627c06a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T10:48:26.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.761+0000 7f62814c8700 1 -- 172.21.15.57:0/3476058025 shutdown_connections 2023-03-03T10:48:26.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.761+0000 7f62814c8700 1 -- 172.21.15.57:0/3476058025 wait complete. 2023-03-03T10:48:26.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.761+0000 7f62814c8700 1 Processor -- start 2023-03-03T10:48:26.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.761+0000 7f62814c8700 1 -- start start 2023-03-03T10:48:26.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.765+0000 7f62814c8700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f627c094700 0x7f627c1c01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T10:48:26.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.765+0000 7f62814c8700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627c093510 con 0x7f627c094700 2023-03-03T10:48:26.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.765+0000 7f627affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f627c094700 0x7f627c1c01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T10:48:26.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.765+0000 7f627affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f627c094700 0x7f627c1c01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:54928/0 (socket says 172.21.15.57:54928) 2023-03-03T10:48:26.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.765+0000 7f627affd700 1 -- 172.21.15.57:0/1844840311 learned_addr learned my addr 172.21.15.57:0/1844840311 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T10:48:26.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.765+0000 7f627affd700 1 -- 172.21.15.57:0/1844840311 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62700094b0 con 0x7f627c094700 2023-03-03T10:48:26.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.765+0000 7f627affd700 1 --2- 172.21.15.57:0/1844840311 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f627c094700 0x7f627c1c01c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f626c00c680 tx=0x7f626c00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T10:48:26.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.765+0000 7f62637fe700 1 -- 172.21.15.57:0/1844840311 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f626c005cc0 con 0x7f627c094700 2023-03-03T10:48:26.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.765+0000 7f62637fe700 1 -- 172.21.15.57:0/1844840311 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626c005e20 con 0x7f627c094700 2023-03-03T10:48:26.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.765+0000 7f62637fe700 1 -- 172.21.15.57:0/1844840311 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f626c007220 con 0x7f627c094700 2023-03-03T10:48:26.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.765+0000 7f62814c8700 1 -- 172.21.15.57:0/1844840311 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f627c08ad60 con 0x7f627c094700 2023-03-03T10:48:26.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.765+0000 7f62814c8700 1 -- 172.21.15.57:0/1844840311 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f627c08abd0 con 0x7f627c094700 2023-03-03T10:48:26.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.769+0000 7f62814c8700 1 -- 172.21.15.57:0/1844840311 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f627c04eff0 con 0x7f627c094700 2023-03-03T10:48:26.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.769+0000 7f62637fe700 1 -- 172.21.15.57:0/1844840311 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 12) v1 ==== 42285+0+0 (secure 0 0 0) 0x7f626c019030 con 0x7f627c094700 2023-03-03T10:48:26.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.769+0000 7f62637fe700 1 --2- 172.21.15.57:0/1844840311 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f62680348d0 0x7f6268036d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T10:48:26.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.769+0000 7f62637fe700 1 -- 172.21.15.57:0/1844840311 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3014+0+0 (secure 0 0 0) 0x7f626c045600 con 0x7f627c094700 2023-03-03T10:48:26.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.769+0000 7f627a7fc700 1 --2- 172.21.15.57:0/1844840311 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f62680348d0 0x7f6268036d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T10:48:26.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.773+0000 7f627a7fc700 1 --2- 172.21.15.57:0/1844840311 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f62680348d0 0x7f6268036d80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f627c094b20 tx=0x7f6270008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T10:48:26.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.777+0000 7f62637fe700 1 -- 172.21.15.57:0/1844840311 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f626c0196b0 con 0x7f627c094700 2023-03-03T10:48:26.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.953+0000 7f62814c8700 1 -- 172.21.15.57:0/1844840311 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f627c093e00 con 0x7f627c094700 2023-03-03T10:48:26.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.953+0000 7f62637fe700 1 -- 172.21.15.57:0/1844840311 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v39) v1 ==== 100+0+11 (secure 0 0 0) 0x7f626c017070 con 0x7f627c094700 2023-03-03T10:48:26.958 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2023-03-03T10:48:26.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.957+0000 7f62814c8700 1 -- 172.21.15.57:0/1844840311 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f62680348d0 msgr2=0x7f6268036d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T10:48:26.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.957+0000 7f62814c8700 1 --2- 172.21.15.57:0/1844840311 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f62680348d0 0x7f6268036d80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f627c094b20 tx=0x7f6270008030 comp rx=0 tx=0).stop 2023-03-03T10:48:26.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.957+0000 7f62814c8700 1 -- 172.21.15.57:0/1844840311 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f627c094700 msgr2=0x7f627c1c01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T10:48:26.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.957+0000 7f62814c8700 1 --2- 172.21.15.57:0/1844840311 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f627c094700 0x7f627c1c01c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f626c00c680 tx=0x7f626c00ca40 comp rx=0 tx=0).stop 2023-03-03T10:48:26.962 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.957+0000 7f62814c8700 1 -- 172.21.15.57:0/1844840311 shutdown_connections 2023-03-03T10:48:26.962 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.957+0000 7f62814c8700 1 --2- 172.21.15.57:0/1844840311 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7f62680348d0 0x7f6268036d80 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T10:48:26.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.957+0000 7f62814c8700 1 --2- 172.21.15.57:0/1844840311 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f627c094700 0x7f627c1c01c0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T10:48:26.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.957+0000 7f62814c8700 1 -- 172.21.15.57:0/1844840311 >> 172.21.15.57:0/1844840311 conn(0x7f627c069f00 msgr2=0x7f627c06e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T10:48:26.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.957+0000 7f62814c8700 1 -- 172.21.15.57:0/1844840311 shutdown_connections 2023-03-03T10:48:26.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:26.957+0000 7f62814c8700 1 -- 172.21.15.57:0/1844840311 wait complete. 2023-03-03T10:48:26.997 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-03-03T10:48:27.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:27.193+0000 7fbde172d700 1 Processor -- start 2023-03-03T10:48:27.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:27.193+0000 7fbde172d700 1 -- start start 2023-03-03T10:48:27.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:27.197+0000 7fbde172d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbddc122f80 0x7fbddc071020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T10:48:27.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:27.197+0000 7fbde172d700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbddc071b30 con 0x7fbddc122bb0 2023-03-03T10:48:27.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:27.197+0000 7fbde172d700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbddc08a020 con 0x7fbddc122f80 2023-03-03T10:48:27.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:27.197+0000 7fbddaffd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fbddc122bb0 0x7fbddc070910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:41292/0 (socket says 172.21.15.57:41292) 2023-03-03T10:48:27.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:27.197+0000 7fbddaffd700 1 -- 172.21.15.57:0/4157943071 learned_addr learned my addr 172.21.15.57:0/4157943071 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-03-03T10:48:27.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:27.197+0000 7fbdd27fc700 1 --2- 172.21.15.57:0/4157943071 >> v2:172.21.15.57:3300/0 conn(0x7fbddc122f80 0x7fbddc071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T10:48:27.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:27.197+0000 7fbdd27fc700 1 -- 172.21.15.57:0/4157943071 >> v1:172.21.15.57:6789/0 conn(0x7fbddc122bb0 legacy=0x7fbddc070910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T10:48:27.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:27.197+0000 7fbdd27fc700 1 -- 172.21.15.57:0/4157943071 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbddc08a2c0 con 0x7fbddc122f80 2023-03-03T10:48:27.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:27.197+0000 7fbdd27fc700 1 --2- 172.21.15.57:0/4157943071 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbddc122f80 0x7fbddc071020 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fbdc40099e0 tx=0x7fbdc4009cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac8097a52ac802d4 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T10:48:27.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:27.197+0000 7fbdda7fc700 1 -- 172.21.15.57:0/4157943071 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbdc4004160 con 0x7fbddc122f80 2023-03-03T10:48:27.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:27.197+0000 7fbdda7fc700 1 -- 172.21.15.57:0/4157943071 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc40042c0 con 0x7fbddc122f80 2023-03-03T10:48:27.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:27.197+0000 7fbdda7fc700 1 -- 172.21.15.57:0/4157943071 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbdc4004580 con 0x7fbddc122f80 2023-03-03T10:48:27.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:27.201+0000 7fbde172d700 1 -- 172.21.15.57:0/4157943071 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbddc122f80 msgr2=0x7fbddc071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T10:48:27.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:27.201+0000 7fbde172d700 1 --2- 172.21.15.57:0/4157943071 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbddc122f80 0x7fbddc071020 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fbdc40099e0 tx=0x7fbdc4009cf0 comp rx=0 tx=0).stop 2023-03-03T10:48:27.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:27.201+0000 7fbde172d700 1 -- 172.21.15.57:0/4157943071 shutdown_connections 2023-03-03T10:48:27.206 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:27.201+0000 7fbde172d700 1 --2- 172.21.15.57:0/4157943071 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbddc122f80 0x7fbddc071020 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T10:48:27.206 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:27.201+0000 7fbde172d700 1 -- 172.21.15.57:0/4157943071 >> 172.21.15.57:0/4157943071 conn(0x7fbddc069f00 msgr2=0x7fbddc06a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T10:48:27.206 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:27.201+0000 7fbde172d700 1 -- 172.21.15.57:0/4157943071 shutdown_connections 2023-03-03T10:48:27.206 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:27.201+0000 7fbde172d700 1 -- 172.21.15.57:0/4157943071 wait complete. 2023-03-03T10:48:27.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:27.201+0000 7fbde172d700 1 Processor -- start 2023-03-03T10:48:27.208 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:27.205+0000 7fbde172d700 1 -- start start 2023-03-03T10:48:27.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:27.205+0000 7fbde172d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbddc122bb0 0x7fbddc1bb220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T10:48:27.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:27.205+0000 7fbde172d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbddc122400 con 0x7fbddc122bb0 2023-03-03T10:48:27.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:27.205+0000 7fbddaffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbddc122bb0 0x7fbddc1bb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T10:48:27.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:27.205+0000 7fbddaffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbddc122bb0 0x7fbddc1bb220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:54944/0 (socket says 172.21.15.57:54944) 2023-03-03T10:48:27.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:27.205+0000 7fbddaffd700 1 -- 172.21.15.57:0/1068332505 learned_addr learned my addr 172.21.15.57:0/1068332505 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-03-03T10:48:27.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:27.205+0000 7fbddaffd700 1 -- 172.21.15.57:0/1068332505 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc40094b0 con 0x7fbddc122bb0 2023-03-03T10:48:27.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:27.205+0000 7fbddaffd700 1 --2- 172.21.15.57:0/1068332505 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbddc122bb0 0x7fbddc1bb220 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc00c480 tx=0x7fbdcc00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T10:48:27.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:27.205+0000 7fbdd3fff700 1 -- 172.21.15.57:0/1068332505 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbdcc005cc0 con 0x7fbddc122bb0 2023-03-03T10:48:27.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:27.205+0000 7fbdd3fff700 1 -- 172.21.15.57:0/1068332505 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdcc005e20 con 0x7fbddc122bb0 2023-03-03T10:48:27.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:27.205+0000 7fbde172d700 1 -- 172.21.15.57:0/1068332505 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbddc071560 con 0x7fbddc122bb0 2023-03-03T10:48:27.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:27.205+0000 7fbdd3fff700 1 -- 172.21.15.57:0/1068332505 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbdcc0049c0 con 0x7fbddc122bb0 2023-03-03T10:48:27.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:27.209+0000 7fbde172d700 1 -- 172.21.15.57:0/1068332505 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbddc1233e0 con 0x7fbddc122bb0 2023-03-03T10:48:27.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:27.209+0000 7fbde172d700 1 -- 172.21.15.57:0/1068332505 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbddc0716f0 con 0x7fbddc122bb0 2023-03-03T10:48:27.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:27.209+0000 7fbdd3fff700 1 -- 172.21.15.57:0/1068332505 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 12) v1 ==== 42285+0+0 (secure 0 0 0) 0x7fbdcc010070 con 0x7fbddc122bb0 2023-03-03T10:48:27.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:27.209+0000 7fbdd3fff700 1 --2- 172.21.15.57:0/1068332505 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fbdbc0348d0 0x7fbdbc036d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T10:48:27.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:27.209+0000 7fbdd3fff700 1 -- 172.21.15.57:0/1068332505 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3014+0+0 (secure 0 0 0) 0x7fbdcc0459f0 con 0x7fbddc122bb0 2023-03-03T10:48:27.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:27.213+0000 7fbdd27fc700 1 --2- 172.21.15.57:0/1068332505 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fbdbc0348d0 0x7fbdbc036d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T10:48:27.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:27.213+0000 7fbdd27fc700 1 --2- 172.21.15.57:0/1068332505 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fbdbc0348d0 0x7fbdbc036d80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4009d30 tx=0x7fbdc4008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T10:48:27.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:27.217+0000 7fbdd3fff700 1 -- 172.21.15.57:0/1068332505 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fbdcc011760 con 0x7fbddc122bb0 2023-03-03T10:48:27.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:27.405+0000 7fbde172d700 1 -- 172.21.15.57:0/1068332505 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbddc091dc0 con 0x7fbddc122bb0 2023-03-03T10:48:27.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:27.409+0000 7fbdd3fff700 1 -- 172.21.15.57:0/1068332505 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v39) v1 ==== 80+0+122 (secure 0 0 0) 0x7fbdcc0113a0 con 0x7fbddc122bb0 2023-03-03T10:48:27.413 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:6811/2058274046 2023-03-04T07:47:57.352461+0000 2023-03-03T10:48:27.414 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:6810/2058274046 2023-03-04T07:47:57.352461+0000 2023-03-03T10:48:27.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:27.409+0000 7fbde172d700 1 -- 172.21.15.57:0/1068332505 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fbdbc0348d0 msgr2=0x7fbdbc036d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T10:48:27.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:27.409+0000 7fbde172d700 1 --2- 172.21.15.57:0/1068332505 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fbdbc0348d0 0x7fbdbc036d80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4009d30 tx=0x7fbdc4008030 comp rx=0 tx=0).stop 2023-03-03T10:48:27.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:27.413+0000 7fbde172d700 1 -- 172.21.15.57:0/1068332505 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbddc122bb0 msgr2=0x7fbddc1bb220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T10:48:27.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:27.413+0000 7fbde172d700 1 --2- 172.21.15.57:0/1068332505 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbddc122bb0 0x7fbddc1bb220 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc00c480 tx=0x7fbdcc00c840 comp rx=0 tx=0).stop 2023-03-03T10:48:27.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:27.413+0000 7fbde172d700 1 -- 172.21.15.57:0/1068332505 shutdown_connections 2023-03-03T10:48:27.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:27.413+0000 7fbde172d700 1 --2- 172.21.15.57:0/1068332505 >> [v2:172.21.15.57:6808/28565,v1:172.21.15.57:6809/28565] conn(0x7fbdbc0348d0 0x7fbdbc036d80 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T10:48:27.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:27.413+0000 7fbde172d700 1 --2- 172.21.15.57:0/1068332505 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbddc122bb0 0x7fbddc1bb220 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T10:48:27.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:27.413+0000 7fbde172d700 1 -- 172.21.15.57:0/1068332505 >> 172.21.15.57:0/1068332505 conn(0x7fbddc069f00 msgr2=0x7fbddc06cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T10:48:27.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:27.413+0000 7fbde172d700 1 -- 172.21.15.57:0/1068332505 shutdown_connections 2023-03-03T10:48:27.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-03-03T10:48:27.413+0000 7fbde172d700 1 -- 172.21.15.57:0/1068332505 wait complete. 2023-03-03T10:48:27.421 INFO:teuthology.orchestra.run.smithi057.stderr:listed 2 entries 2023-03-03T10:48:27.450 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi057.front.sepia.ceph.com... 2023-03-03T10:48:27.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T10:48:27.451 DEBUG:teuthology.orchestra.run.smithi057:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-03-03T10:48:27.491 INFO:teuthology.orchestra.run.smithi057.stderr:fusermount: failed to unmount /home/ubuntu/cephtest/mnt.0: Device or resource busy 2023-03-03T10:48:27.497 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-03T10:48:27.498 INFO:tasks.cephfs.fuse_mount:Failed to unmount ceph-fuse on ubuntu@smithi057.front.sepia.ceph.com, aborting... 2023-03-03T10:48:27.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T10:48:27.499 DEBUG:teuthology.orchestra.run.smithi057:> sudo PATH=/usr/sbin:$PATH lsof ; ps auxf 2023-03-03T10:48:36.016 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:49:06.098 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:49:36.182 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:50:06.258 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:50:36.344 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:51:06.434 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:51:36.529 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:52:06.614 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:52:36.706 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:53:06.795 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:53:27.553 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/virtualenv/lib/python3.8/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2023-03-03T10:53:27.561 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/virtualenv/lib/python3.8/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2023-03-03T10:53:36.891 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:54:06.962 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:54:37.045 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:55:07.127 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:55:37.203 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:56:07.283 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:56:37.372 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:57:07.460 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:57:37.540 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:58:07.646 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:58:37.734 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:59:07.819 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:59:37.913 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:00:07.998 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:00:38.086 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:01:08.174 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:01:38.278 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:02:08.355 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:02:38.432 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:03:08.518 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:03:38.655 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:04:08.741 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:04:38.828 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:05:08.905 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:05:38.991 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:06:09.061 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:06:39.152 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:07:09.230 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:07:39.302 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:08:09.384 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:08:39.485 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:09:09.561 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:09:39.649 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:10:09.743 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:10:39.822 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:11:09.909 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:11:39.992 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:12:10.082 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:12:40.160 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:13:10.235 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:13:40.318 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:14:10.416 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:14:40.500 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:15:10.582 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:15:40.662 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:16:10.747 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:16:40.840 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:17:10.932 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:17:41.019 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:18:11.097 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:18:41.180 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:19:11.263 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:19:41.341 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:20:11.418 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:20:41.510 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:21:11.590 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:21:41.673 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:22:11.759 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:22:41.842 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:23:11.919 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:23:42.011 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:24:12.095 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:24:42.169 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:25:12.246 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:25:42.334 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:26:12.418 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:26:42.511 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:27:12.586 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:27:42.671 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:28:12.754 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:28:42.828 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:29:12.916 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:29:43.000 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:30:13.083 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:30:43.169 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:31:13.251 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:31:43.344 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:32:13.435 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:32:43.512 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:33:13.604 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:33:43.714 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:34:13.796 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:34:43.874 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:35:13.956 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:35:44.037 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:36:14.109 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:36:44.204 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:37:14.281 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:37:44.370 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:38:14.463 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:38:44.549 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:39:14.633 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:39:44.716 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:40:14.810 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:40:44.895 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:41:14.979 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:41:45.070 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:42:15.150 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:42:45.234 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:43:15.310 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:43:45.395 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:44:15.480 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:44:45.566 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:45:15.646 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:45:45.723 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:46:15.797 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:46:45.883 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:47:15.964 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:47:46.041 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:48:16.114 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:48:46.196 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:49:16.317 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:49:46.408 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:50:16.500 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:50:46.582 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:51:16.662 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:51:46.762 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:52:16.849 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:52:46.926 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:53:17.010 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:53:47.087 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:54:17.184 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:54:47.277 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:55:17.368 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:55:47.457 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:56:17.543 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:56:47.651 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:57:17.731 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:57:47.816 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:58:17.905 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:58:47.988 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:59:18.073 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:59:48.214 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:00:18.275 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:00:48.355 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:01:18.436 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:01:48.532 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:02:18.612 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:02:48.694 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:03:18.776 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:03:48.861 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:04:18.949 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:04:49.027 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:05:19.101 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:05:49.179 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:06:19.263 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:06:49.390 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:07:19.481 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:07:49.567 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:08:19.656 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:08:49.742 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:09:19.822 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:09:49.911 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:10:19.984 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:10:50.067 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:11:20.154 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:11:50.248 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:12:20.328 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:12:50.417 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:13:20.499 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:13:50.573 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:14:20.648 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:14:50.746 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:15:20.827 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:15:50.918 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:16:21.005 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:16:51.105 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:17:21.185 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:17:51.258 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:18:21.342 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:18:51.420 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:19:21.504 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:19:51.583 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:20:21.660 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:20:51.743 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:21:21.825 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:21:51.926 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:22:22.005 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:22:52.096 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:23:22.185 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:23:52.279 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:24:22.358 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:24:52.449 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:25:22.521 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:25:52.615 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:26:22.704 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:26:52.801 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:27:22.886 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:27:52.975 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:28:23.073 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:28:53.159 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:29:23.247 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:29:53.337 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:30:23.416 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:30:53.504 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:31:23.606 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:31:53.713 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:32:23.800 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:32:53.866 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:33:23.946 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:33:54.037 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:34:24.109 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:34:54.192 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:35:24.280 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:35:54.374 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:36:24.463 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:36:54.568 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:37:24.656 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:37:54.753 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:38:24.956 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:38:55.046 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:39:25.125 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:39:55.220 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:40:25.312 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:40:55.401 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:41:25.486 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:41:55.592 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:42:25.681 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:42:55.775 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:43:25.865 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:43:55.961 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:44:26.032 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:44:56.119 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:45:26.203 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:45:56.300 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:46:26.380 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:46:56.484 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:47:26.568 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:47:56.656 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:48:26.745 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:48:56.826 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:49:26.915 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:49:56.999 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:50:27.101 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:50:57.188 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:51:27.278 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:51:57.381 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:52:27.468 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:52:57.558 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:53:27.649 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:53:57.739 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:54:27.823 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:54:57.948 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:55:28.029 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:55:58.117 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:56:28.205 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:56:58.304 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:57:28.387 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:57:58.476 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:58:28.554 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:58:58.643 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:59:28.731 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:59:58.819 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:00:28.908 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:00:58.995 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:01:29.086 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:01:59.184 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:02:29.263 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:02:59.344 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:03:29.432 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:03:59.520 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:04:29.617 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:04:59.705 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:05:29.793 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:05:59.891 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:06:29.978 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:07:00.084 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:07:30.173 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:08:00.268 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:08:30.355 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:09:00.563 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:09:30.644 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:10:00.749 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:10:30.832 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:11:00.927 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:11:31.021 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:12:01.128 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:12:31.208 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:13:01.302 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:13:31.383 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:14:01.473 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:14:31.560 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:15:01.640 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:15:31.728 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:16:01.832 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:16:31.913 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:17:02.024 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:17:32.113 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:18:02.202 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:18:32.281 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:19:02.366 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:19:32.453 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:20:02.550 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:20:32.640 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:21:02.739 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:21:32.828 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:22:02.932 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:22:33.018 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:23:03.107 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:23:33.187 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:24:03.258 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:24:33.344 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:25:03.432 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:25:33.522 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:26:03.610 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:26:33.688 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:27:03.795 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:27:33.884 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:28:03.981 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:28:34.069 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:29:04.148 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:29:34.218 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:30:04.306 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:30:34.404 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:31:04.494 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:31:34.581 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:32:04.680 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:32:34.768 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:33:04.856 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:33:34.943 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:34:05.023 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:34:35.111 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:35:05.200 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:35:35.287 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:36:05.376 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:36:35.462 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:37:05.580 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:37:35.667 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:38:05.747 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:38:35.830 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:39:05.919 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:39:36.008 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:40:06.099 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:40:36.179 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:41:06.270 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:41:36.358 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:42:06.458 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:42:36.545 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:43:06.660 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:43:36.753 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:44:06.840 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:44:36.919 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:45:07.003 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:45:37.097 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:46:07.190 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:46:37.280 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:47:07.385 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:47:37.469 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:48:07.554 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:48:37.639 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:49:07.723 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:49:37.816 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:50:07.909 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:50:38.002 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:51:08.093 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:51:38.185 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:52:08.291 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:52:38.373 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:53:08.454 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:53:38.538 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:54:08.626 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:54:38.715 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:55:08.802 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:55:38.878 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:56:08.950 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:56:39.036 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:57:09.136 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:57:39.224 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:58:09.314 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:58:39.398 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:59:09.486 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:59:39.568 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:00:09.664 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:00:39.741 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:01:09.831 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:01:39.920 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:02:10.010 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:02:40.083 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:03:10.182 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:03:40.263 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:04:10.342 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:04:40.460 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:05:10.558 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:05:40.647 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:06:10.738 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:06:40.818 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:07:10.927 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:07:41.008 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:08:11.106 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:08:41.204 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:09:11.294 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:09:41.368 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:10:11.455 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:10:41.545 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:11:11.651 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:11:41.743 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:12:11.844 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:12:41.936 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:13:12.020 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:13:42.102 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:14:12.184 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:14:42.284 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:15:12.379 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:15:42.455 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:16:12.553 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:16:42.633 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:17:12.739 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:17:42.830 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:18:12.910 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:18:42.999 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:19:13.089 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:19:43.167 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:20:13.252 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:20:43.333 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:21:13.423 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:21:43.531 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:22:13.634 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:22:43.722 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:23:13.811 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:23:43.899 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:24:13.994 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:24:44.082 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:25:14.149 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:25:44.226 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:26:14.350 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:26:44.419 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:27:14.514 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:27:44.603 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:28:14.678 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:28:44.759 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:29:14.844 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:29:44.919 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:30:15.008 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:30:45.089 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:31:15.180 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:31:45.267 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:32:15.373 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:32:45.462 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:33:15.537 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:33:45.618 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:34:15.716 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:34:45.811 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:35:15.906 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:35:45.993 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:36:16.081 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:36:46.163 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:37:16.270 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:37:46.398 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:38:16.490 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:38:46.574 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:39:16.655 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:39:46.734 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:40:16.826 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:40:46.906 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:41:16.988 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:41:47.070 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:42:17.183 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:42:47.265 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:43:17.355 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:43:47.434 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:44:17.522 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:44:47.607 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:45:17.683 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:45:47.779 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:46:17.873 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:46:47.950 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:47:18.062 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:47:48.134 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:48:18.228 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:48:48.311 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:49:18.403 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:49:48.485 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:50:18.575 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:50:48.658 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:51:18.733 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:51:48.811 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:52:18.915 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:52:48.994 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:53:19.091 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:53:49.174 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:54:19.271 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:54:49.354 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:55:19.448 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:55:49.532 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:56:19.626 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:56:49.708 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:57:19.811 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:57:49.896 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:58:19.982 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:58:50.058 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:59:20.151 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:59:50.242 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:00:20.326 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:00:50.402 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:01:20.492 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:01:50.581 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:02:20.687 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:02:50.771 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:03:20.856 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:03:50.931 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:04:21.024 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:04:51.107 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:05:21.206 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:05:51.283 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:06:21.373 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:06:51.463 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:07:21.574 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:07:51.656 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:08:21.755 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:08:51.839 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:09:21.928 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:09:52.014 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:10:22.118 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:10:52.194 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:11:22.297 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:11:52.370 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:12:22.530 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:12:52.613 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:13:22.696 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:13:52.772 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:14:22.866 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:14:52.951 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:15:23.053 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:15:53.122 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:16:23.213 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:16:53.294 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:17:23.396 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:17:53.475 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:18:23.568 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:18:53.651 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:19:23.744 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:19:53.832 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:20:23.941 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:20:54.034 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:21:24.142 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:21:54.221 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:22:24.336 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:22:54.420 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:23:24.525 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:23:54.603 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:24:24.700 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:24:54.788 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:25:24.881 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:25:54.955 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:26:25.052 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:26:55.122 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:27:25.226 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:27:55.303 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:28:25.396 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:28:55.470 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:29:25.566 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:29:55.644 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:30:25.731 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:30:55.806 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:31:25.894 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:31:55.976 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:32:26.081 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:32:56.155 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:33:26.245 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:33:56.321 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:34:26.389 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:34:56.472 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:35:26.562 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:35:56.646 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:36:26.730 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:36:56.824 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:37:26.926 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:37:56.996 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:38:27.109 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:38:57.187 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:39:27.276 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:39:57.358 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:40:27.461 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:40:57.544 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:41:27.635 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:41:57.715 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:42:27.816 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:42:57.893 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:43:27.986 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:43:58.070 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:44:28.158 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:44:58.235 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:45:28.331 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:45:58.409 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:46:28.497 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:46:58.575 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:47:28.673 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:47:58.749 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:48:28.841 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:48:58.917 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:49:29.007 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:49:59.079 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:50:29.160 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:50:59.243 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:51:29.330 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:51:59.411 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:52:29.517 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:52:59.599 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:53:29.686 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:53:59.758 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:54:29.849 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:54:59.922 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:55:30.010 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:56:00.091 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:56:30.179 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:57:00.259 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:57:30.365 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:58:00.438 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:58:30.526 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:59:00.608 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:59:30.704 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:00:00.777 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:00:30.865 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:01:00.945 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:01:31.043 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:02:01.115 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:02:31.220 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:03:01.300 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:03:31.390 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:04:01.470 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:04:31.542 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:05:01.621 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:05:31.719 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:06:01.788 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:06:31.878 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:07:01.960 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:07:32.066 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:08:02.146 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:08:32.225 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:09:02.306 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:09:32.395 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:10:02.471 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:10:32.563 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:11:02.643 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:11:32.731 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:12:02.818 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:12:32.923 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:13:03.002 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:13:33.100 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:14:03.191 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:14:33.278 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:15:03.362 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:15:33.454 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:16:03.536 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:16:33.628 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:17:03.707 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:17:33.806 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:18:03.887 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:18:33.984 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:19:04.058 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:19:34.262 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:20:04.336 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:20:34.427 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:21:04.508 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:21:34.601 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:22:04.677 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:22:34.779 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:23:04.858 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:23:34.949 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:24:05.032 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:24:35.110 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:25:05.186 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:25:35.274 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:26:05.347 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:26:35.438 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:27:05.519 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:27:35.609 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:28:05.691 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:28:35.778 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:29:05.862 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:29:35.959 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:30:06.048 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:30:36.156 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:31:06.235 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:31:36.326 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:32:06.407 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:32:36.496 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:33:06.577 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:33:36.698 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:34:06.778 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:34:36.869 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:35:06.951 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:35:37.050 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:36:07.132 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:36:37.237 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:37:07.319 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:37:37.417 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:38:07.490 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:38:37.579 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:39:07.657 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:39:37.748 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:40:07.828 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:40:37.910 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:41:07.982 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:41:38.072 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:42:08.154 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:42:38.255 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:43:08.335 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:43:38.431 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:44:08.513 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:44:38.603 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:45:08.684 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:45:38.774 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:46:08.845 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:46:38.927 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:47:08.995 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:47:39.095 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:48:09.192 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:48:39.289 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:49:09.369 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:49:39.455 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:50:09.527 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:50:39.617 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:51:09.700 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:51:39.786 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:52:09.857 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:52:39.966 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:53:10.044 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:53:40.136 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:54:10.216 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:54:40.289 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:55:10.362 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:55:40.452 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:56:10.533 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:56:40.619 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:57:10.695 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:57:40.802 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:58:10.880 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:58:40.964 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:59:11.043 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:59:41.134 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:00:11.206 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:00:41.296 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:01:11.366 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:01:41.446 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:02:11.530 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:02:41.626 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:03:11.708 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:03:41.798 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:04:11.869 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:04:41.952 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:05:12.039 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:05:42.114 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:06:12.194 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:06:42.285 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:07:12.355 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:07:42.445 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:08:12.528 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:08:42.622 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:09:12.705 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:09:42.801 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:10:12.871 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:10:42.963 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:11:13.043 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:11:43.131 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:12:13.213 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:12:43.319 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:13:13.400 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:13:43.471 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:14:13.554 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:14:43.645 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:15:13.723 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:15:43.812 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:16:13.886 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:16:43.974 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:17:14.041 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:17:44.138 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:18:14.226 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:18:44.315 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:19:14.396 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:19:44.484 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:20:14.688 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:20:44.765 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:21:14.859 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:21:44.946 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:22:15.151 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:22:45.249 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:23:15.329 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:23:45.426 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:24:15.507 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:24:45.595 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:25:15.676 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:25:45.772 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:26:15.859 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:26:45.948 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:27:16.030 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:27:46.136 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:28:16.213 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:28:46.303 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:29:16.386 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:29:46.474 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:30:16.585 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:30:46.680 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:31:16.759 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:31:46.856 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:32:16.939 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:32:47.040 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:33:17.113 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:33:47.207 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:34:17.283 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:34:47.364 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:35:17.445 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:35:47.536 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:36:17.615 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:36:47.706 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:37:17.787 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:37:47.885 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:38:17.955 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:38:48.047 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:39:18.119 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:39:48.216 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:40:18.298 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:40:48.378 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:41:18.450 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:41:48.538 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:42:18.614 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:42:48.710 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:43:18.791 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:43:48.881 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:44:18.960 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:44:49.043 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:45:19.124 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:45:49.203 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:46:19.287 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:46:49.367 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:47:19.438 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:47:49.544 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:48:19.627 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:48:49.714 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:49:19.789 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:49:49.870 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:50:19.951 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:50:50.040 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:51:20.120 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:51:50.191 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:52:20.274 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:52:50.387 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:53:20.470 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:53:50.558 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:54:20.639 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:54:50.732 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:55:20.827 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:55:50.917 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:56:20.995 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:56:51.087 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:57:21.285 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:57:51.391 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:58:21.469 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:58:51.545 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:59:21.616 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:59:51.707 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:00:21.787 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:00:51.877 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:01:21.958 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:01:52.038 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:02:22.117 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:02:52.223 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:03:22.305 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:03:52.409 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:04:22.493 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:04:52.587 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:05:22.661 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:05:52.750 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:06:22.831 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:06:52.919 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:07:22.999 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:07:53.105 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:08:23.185 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:08:53.283 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:09:23.369 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:09:53.443 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:10:23.514 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:10:53.604 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:11:23.690 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:11:53.789 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:12:23.867 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:12:53.967 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:13:24.046 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:13:54.135 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:14:24.223 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:14:54.311 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:15:24.384 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:15:54.465 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:16:24.545 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:16:54.626 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:17:24.705 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:17:54.802 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:18:24.881 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:18:54.969 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:19:25.044 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:19:55.132 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:20:25.214 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:20:55.303 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:21:25.380 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:21:55.472 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:22:25.560 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:22:55.658 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:23:25.738 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:23:55.834 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:24:25.908 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:24:56.005 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:25:26.087 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:25:56.167 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:26:26.249 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:26:56.330 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:27:26.410 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:27:56.517 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:28:26.598 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:28:56.679 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:29:26.752 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:29:56.822 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:30:26.894 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:30:56.970 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:31:27.050 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:31:57.140 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:32:27.213 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:32:57.312 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:33:27.385 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:33:57.475 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:34:27.553 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:34:57.647 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:35:27.729 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:35:57.834 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:36:27.915 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:36:58.003 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:37:28.077 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:37:58.175 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:38:28.254 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:38:58.353 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:39:28.423 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:39:58.515 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:40:28.600 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:40:58.691 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:41:28.772 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:41:58.853 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:42:28.942 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:42:59.048 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:43:29.136 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:43:59.225 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:44:29.298 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:44:59.391 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:45:29.472 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:45:59.561 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:46:29.642 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:46:59.732 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:47:29.811 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:47:59.909 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:48:30.059 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:49:00.138 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:49:30.220 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:50:00.302 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:50:30.375 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:51:00.465 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:51:30.546 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:52:00.636 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:52:30.715 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:53:00.838 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:53:30.911 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:54:01.000 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:54:31.080 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:55:01.147 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:55:31.221 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:56:01.303 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:56:31.384 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:57:01.473 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:57:31.554 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:58:01.652 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:58:31.742 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:59:01.830 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:59:31.904 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T19:00:01.976 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T19:00:32.058 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T19:01:02.148 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T19:01:32.233 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T19:02:02.328 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T19:02:32.406 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T19:03:02.495 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T19:03:32.576 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T19:04:02.722 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T19:04:32.804 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T19:05:02.884 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T19:05:32.967 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T19:06:03.065 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T19:06:33.152 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T19:07:03.240 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T19:07:33.320 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T19:08:03.412 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T19:08:33.475 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T19:09:03.568 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T19:09:33.650 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T19:10:03.746 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T19:10:33.828 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T19:11:03.925 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T19:11:34.016 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T19:12:04.102 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T19:12:34.186 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T19:13:04.292 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T19:13:34.355 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T19:14:04.446 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T19:14:34.525 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T19:15:04.614 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T19:15:34.695 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T19:16:04.791 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T19:16:34.864 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T19:17:04.954 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T19:17:35.035 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T19:18:05.142 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T19:18:35.223 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T19:19:05.321 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T19:19:35.409 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T19:20:05.498 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T19:20:35.579 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T19:21:05.666 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T19:21:35.750 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T19:22:05.838 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T19:22:35.918 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T19:23:06.018 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T19:23:36.099 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T19:24:06.186 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T19:24:36.263 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T19:25:06.352 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T19:25:36.431 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T19:26:06.513 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T19:26:36.593 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T19:27:06.681 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T19:27:36.763 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T19:27:44.438 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-03-03T19:27:44.439 DEBUG:teuthology.task.console_log:Killing console logger for smithi057 2023-03-03T19:27:44.440 DEBUG:teuthology.exit:Finished running handlers